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ABSTRACT 


A cohesive and detailed treatment of the theory and 
engineering amplications of trajectory Sensitiviry 227 pre 
sented. Fundamental results that provide insight into the 
theoretical aspects of trajectory sensitivity analysis, in 
both the frequency and time domains, are reviewed. Several 
related methods for incorporating sensitivity considerations 
in the design of systems are presented and used to solve a 
meaningful fifth-order numerical example: a flexible space 
vehicle in booster powered flight. Comparisons are made 
between an optimal design and designs which include a sen--: 
Peavivity term in the performance measure and conclusions 
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1.5 pL NTRORUC Ler 


During recent years;eene seamen tor solutions CO Op- 
timal control system problems has been quite intensive. 
In particular, optimal feedback control of linear dynamical 
systems has been studied extensively. This attention to 
feedback control is well placed. As Bode pointed out [1], 
feedback control is particularly desirable in that it 
1) tends to stablize systems, 2) reduces the effects on 
time output due to extraneous noise or non-linear das (Cir= 
tion in the plant, and 3) tends to reduce the effects on 
the system transfer characteristics caused by variation in’ 


Plant parameters. “The research in the area of optimal ilin- 


knowledge about the theoretical aspects of the unconstrained 
Hinear state regulator problem. The necessary and sufficient 
Senaitctons for the sodwtion of this problem are well known 
(2, 3, 4]. Despite apparently complete knowledge concerning 
optimal linear state regulator control theory, its implemer- 
meeron in practical applications generally requires the use 
Saeapeital computers and may be limited in many instances 
EeeecOost considerations. 

There are several other reasons why the optimal linear 
state regulator solution may not be implemented. These 
reasons are related to necessary conditions or assumptions 
required for the theoretical solution of the problem (all 


states available for feedback, control unconstrained and 








time-varying) or engineering considerations concerned with 
formulation of thé system model and its controller. | Anone 
Che latter are considerations (or Ghes seme el rere ne 
response of a dynamic system to variations in plant para- 
mearers., 

Every control problem, modern omvellascrcalepeo is 
with the formulation of a system mcdel. Generally, this 
model takes the form of one or more nonlinear time varying 
differential equations. This nontrivial process of system 
modelling, perhaps after much refinement, can ultimately 
result in a system described by a set of first-order ordi- 


nary differential state equations [5] of the form 
KCC )e =a cileuGry ce Uae nel (1.1) 


mimene X(t) is the state n-vector 
q(t) is the variable parameter r—vector 
Met) le che: Comecod iii: i 7-e vor 
t is the independent variable, usually time. 

A physical system mathematically modelled by equations 
ef the form of (1.1) are the subject of extensive design 
and analysis techniques. The results of thése techniques 
are generally assumed to be valid and applicable to the 
Piysical SYStemomeelhe Veladivy  OMmicnisrasculpt4 Oneted Ummcs 
@ereiul scrutiny. 

No matter how careful and precise the engineer is in 
establishing his model, there will always exist differences 
between the behavior of the physical system and that pre- 
dicted by equations like (1.1). The vector function, a(.), 
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in (1.1) cannot, in general, be exeetiy determined aac 
parameters q(t) are, for many meaningful systems, diffi- 
cult to measure accurately and in any event will have tol- 
Crances associated with thems The solution on (i. bie i 
generally yield only to the approximate techniques of the 
digital or analog computer. Even if the modelling diffi- 
eulties mentioned above did not exist, the problem of 
changes in system components due to aging, environmental 
changes and repair part exchanges would introduce model- 
ling inaccuracies. It is clear that even under the very 
best of circumstances, differences will exist between the 
system and its model. 

In order to obtain the advantages of linear optimal 
Centrol theory, 2 nonlinesr system may be solved for™its 
optimal trajectory and then an approximate linear system 
may be formulated relating small variations from the non- 
mmcar optimal trajectory. The approximations involved 
lead to model inaccuracies and again differences between 
system behavior and modelled behavior will exist. 

In many physical plants, all of the states are not 
available for feedback. In this case, implementation of 
the optimal linear state resulaeee problem may not be fea- 
sible [3]. However, if the system is completely observ- 
able, the states can be computed from the output [4]. 
Ssehemes for obtaining the system states from the system 
output include the use of observers [6] and Kalman filters 


[7]. However, these techniques use the system model in 








their realizations and consequently introduce additional 
Var 1 avaonseinco thers ysten- 

Assuming that the modelling process and the model's 
solution is an accurate representation of the ae trans- 
kabing the solution into Controller Si cnake worm. ceo 
subject to many of the variations discussed above. Hence, 
implementation of the controller may introduce system in- 
mecuraciles. 

Ignoring all of these difficulties, the "perfectly" 
modelled plant and "perfectly" implemented controller may 
still be inadequate. This "perfect" system may be unable 
Mmemeope Successfully wath reandomsorecyvcnsdevtcrmimasidac 
meouurbance inputs to whieh the system may bessubjected: 

Over Pecans as classical feedback theory has been 
developed, in recognition of the many uncertainties in- 
bnerent in system design, a compatible theory for sensitiv-—- 
ity analysis has also been developed [8]. This theory for 
the most part is based on Bode's definition [1] of sensi- 
tivity. From it developed a "Folk Theorem" [9] which 
fae Cl lece iat Ghe Sensual Ole tile trans tor 
eharacteristics of a system to parameter variations is re- 
duced as the feedback gains are increased. This theorem 
works in many cases, and is frequently the only tool ap- 
plied to sensitivity reduction in the design of many clas- 
psec controllers. 

Presently considerable research effort is being di- 


rected at the problem of developing sensitivity analysis 








and reduced sensitivity design tCechniques compatible with 
modern control theory. In multiple-input multiple-output 
systems cast as optimal control problems interest has been 
concentrated in several system characteristics in addi- 
titom to the system Cransier fumevron. These mimelude wtrmae 
sensitivities of state trajectories, periormance measures, 
system eigenvalues, and final states to variations of ini- 
Geral conditions “and plant or controller paramevers. 

In this thesis, an historical review of sensitivity 
Micory Compatible with modern control vuneory 1s presecaved. 
Next a general theory for trajectory sensitivity analysis 
is reviewed and applied to the optimal state regulator 
problem. Then several current techniques proposed for 
designing optimal linear regulators with reduced sensitiv—- 
immo s are investigated. =finally someworsricse veCchinieics 
are applied to the solution of a fiexible Saturn booster 


pmaemeeen and the resultime mumericalssolutions@are compared: 








ft. HISTORLC Aaa 


Avs CLASSICAL SENSTT Byaery 

The basic concepts that provyade thew cundar vormenens 
modern sensitivity theory appeared in the fundamental work 
of Bode [1] which also marks the beginning of the modern 
theory of feedback systems. Bode defined feedoack in terms 
Oi the return difference and at the same time established 
peveral important relationships between feedback and sensi- 
miyity., in the development of automatic control theory 
that followed, analysis and design formulations should have 
included sensitivity as an important adjunct. Such, how- 
ever, was not the Sem Until the beginning of the last 
decade, little ean be found in the literature relating con- 
brol systems and sensitivity. In an important exception 
[10], Truxal briefly discussed return difference and sen- 
PeeuiVity within the context of signal flow graphs. 

Horowitz [11] argued that the use of feedback loops 
to reduce sensitivity of the system transfer function to 
Substantial plant parameter variations or random distur- 
bances is as effective as the use of adaptive systems with- 
out their added complexity. Hewconetided @py usmise the 
Seetcoical Sensitivity analysis technmques , ayeat the inade- 
Gguaecies abtribuved to feedback systems Dy adaptive sysvem 
designers were unfounded. Indeed, given the same design 
constraints, he demonstrated that whatever performance had 
been claimed for adaptive systems could be matched with con- 


Siderably less complexity by feedback control systems. [In 
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his book, Synthesis of Feedback Systems [12], Horowitz 


provided én excellent and complete treatment of classical 
control system design with sensitivity considerations. He 
applied the classical design techniques (root locus, Bode 
Spiots, Nyquist criterion) to the @désigsnmor systems aura 
reduced sensitivity to plant parameter variations and ran- 
gom input disturbances,. 

It should be noted that almost all of these early 
studies [1, 10, 11, 12] were confined to Laplace transform 
ema frequency domain analysis of sensitivity. These tech-— 
niques were applied mainly to determining the sensitivity 
of the system transfer function to changes of system pa- 


mamever. Root locus techniques were appiied alse comdeter— 
mine the sensitivity of pnole-zero locations to variations 
Siea System parameter [12]. Horowitz pointed out {12} 

that the desired system performance is generally a time 
Geman specification, and that any correlation that exists 
between system frequency response and time response is ap- 
proximate. If system time response is accurately required, 
then a time domain synthesis technique must be used. 

Miller and Murray [13], in establishing a mathematical- 
iesound basis for error analysis for the solutions of ordi- 
meawy differential equations by machine methods, derived the 
differential equation that describes the sensitivity coef- 
ficients of the system. This same "sensitivity equation" 
provided the time domain sensitivity nse Techniques 


described by Tomovic [8]. 
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Kokotovic [14] proposed his "“sencdit igi me mnie 
method for linear systems Dy whiecneine Sena rd Vit joe ae 
system scalar output to variations of each ol the voianar 
parameters could be obtained. In fact, when implemented 
on the analog computer all of these sensitivities could 
be obtained simultaneously. This time domain method was 
extended to provide an automatic analog computer parameter 
memimsazavion of the difference between a normlwen the our 
put trajectory of an analog system and the output of a 
soecified standard model. 

In a recent paper [15], Wilkie and Perkins presented 
a method of finding the sensitivities of all of the states 


of a linear time-invariant system to each of the system 


- - a 


parameters simultaneously. The method required modelling 
mae ti—th order linear system in the companion canonic stave 
morn, plus an additional n-th order sensitivity model and 
peooanele-input n-th order system model for each snpupein 
exeess of 1. This led to the requirement of em-l1 n-th 
order models independent of the number of Henaneeees for 

a system having m inputs. This was a SereHeeame reduc-— 
mom in the number of models required over previous tech— 
niques, where an n-th order sensitivity model was required 
for each parameter considered. The Perkins-Wilkie method 


assumed that the linear system could be transformed into 


the companion canonic state form. 


lee 








Bi OF MIMAL CONTRO Sr No el hamid 

It is interesting that the irs’ spud iedere a. 
concerning the sensitivity of soptvima ie onvrs ies, sccimoms mies 
turned out to be a restatement of Bode's theorem relating 
return difference and sensitivity. Kalman, in solving the 
maverse problem of optimal control theory for linear stave 
regulator problems, established a necessary condition for 
muvee SsOlUtiON. He showed that if a feedback control Yaw iis 
optimal, then the magnitude of the return difference for 
the feedback system must be greater than one. Additional 
iWesults are obtained that tend €o bridge "ene gap, vo sonic 
extent, between classical and optinal control theory. 
Kaiman's very complete discussion included important re- 
sults concerning stability, improvement of sensitivity, and 
frequency-domain criteria for this essentially time domain 
problem. 

im 2 devellepmeme Similar to toapeot |[lo) eer amc emd 
Cruz [17] developed a sensitivity matrix operator which 
relates the open-loop and closed-loop system output varia- 
tions. They established a sensitivity index which is a 
measure of the weighted mean square output error. By ap- 
plying Parseval's ee overs the sensitivity index, they 
derived a frequency domain sufficiency condition that en- 
smres sensitivity reduction. Additionally Perkins and Cruz 
demonstrated that if a system is designed to satisfy the 
ema ticiency condition mentmoned “above, then the system as 
optimal in the sense that the constant, linear control law 


obtained minimizes an infinite-time quadratic performance 


Ls 








measure and at the same time transiers the states of @ 
linear time-invariant completely controllable system from 
some initial state vo the eriein asamp verlecahih 

Kreindler in [18] derived results similar to those of 
[16] and [17]. He established sufficient conditions which 
guarantee for multiple-input multiple-output linear regu- 
lator systems that the integral of a certain quadratic form 
of the closed-loop sensitivity is less than the correspond- 
moe integral for the open-loop system. Additionally, tor 
Single-input systems in the companion canonic form, the 
sufficiency condition ensured that the integral of the 
square of each closed-loop sensitivity trajectory will be 
tees than the corresponding open-loop integral. This was 
eevaluable result. 

The analysis techniques discussed in the literature 
eited above have not resulted in established design tech- 
niques. Several authors [19, 20, 21, 22] defined a sensi- 
tivity differential equation after Miller and Murray [13] 
for each variable parameter, augmented the resulting dif- 
ferential equations to the system state equations, defined 
a performance measure with added quadratic terms measuring 
sensitivity, and then solved the resulting system using 
eve tdaniltonian and Pontryagin's™Waximum principle to ob-— 
tain a reduced sensitivity design. The resulting feedback 
Control law was a linear combination of the system states 
and the augmented state Seisi citi coal 

Dompe and Dorf [21] demonstrated with a second-order 
example, that Kahne's [19] design scheme does indeed result 
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in a feedback control system with reduced sensitivity. 
The control law did™@mot result in the oOpuimat Soll smoneon 
the mathematical model defined because Kahne neglected the 
effects of parameter variation on the feedback states. 

Cassidy and Lee [22] included the terms excluded by 
Kahne. 

D'Angelo, et.ai., [20] proposed a reduced sensitivity 
design technique with an infinite-time performance measure 
resulting in constant feedback gains. 

Higginbotham [23] included an additional term in the 
sensitivity differential equation that was neglected both 
by Kahne [19] and Cassidy and Lee [22]. He presented a 
comparison of [19] and [22] using a first-order example. 
By use of the examnle, he demonstrated that the Cassidy 
and Lee technique results in a lower "cost" than Kahne's 
technique. No comparison was made of the resulting sensi- 
taty reduction, if any. 

All of the above optimal sensitivity analysis and 
design techniques were concerned with transfer funcewon re 
trajectory sensitivity. Considerable pes@encn has aka 
been directed at the so-called performance sensitivity 
Problem. The concern here is with variations in the per- 
formance index resulting from parameter variations. In a 
basic result, Pagurek [24] demonstrated that the performance 
index sensitivity to plant parameter variations for open- 
loop and closed-loop optimal linear state regulators are 
equal. This is an astounding result tnat seemed to imply 


Pie beneciibs Of Téedback with respect to plant parameter 
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variations were not available to optimal linear sysvemer 
This result was extended to a large class of nonlinear coe 
timal control problems by Witsenhausen [25]. 

Although the results of [24] and [25] hold for infin- 
itesimal parameter variations, Sinha and Atluri [26] showed 
that for finite but small variations the closed-loop per- 
formance index sensitivity is less than the open-loop sen- 
sitivity. Kreindler [18] made a similar argument in favor 
of feedback systems. 

In a design procedure for minimizing performance mea- 
sure sensitivity Rohrer and Sobral [27] introduced qa "rela- 
tive sensitivity" function. The procedure resulted in a 
minimax solution that is applicable for large parameter 
variations. 

Salmon [28] generalized the Rohrer and Sobral proce- 
@ueee and proposed a new minimax algorithm for its solution. 

Very recently Cassidy and Roy [29] described what ap-— 
pears to be a promising scheme for designing insensitive 
mmiear Output regulator systems. By modifying the usual 
G@uadratic performance measure they were able to constrain 
the feedback coefficients multiplying the unmeasured states 
to zero. Thus output feedback was obtained. They defined 
mime Stave Sensitivity differential equations, adjoined them 
to the state equations i form an augmented state vector. 

A sensitivity term was added to the performance measure and 
meet specitic Optimalscentrol (SOC) approach resulted duva 
wOMebvany feedback controller That did nov require kmoyvledec 


of the sensitivity variables nor the unmeasured states. 
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Much work in the area of sensitivity design remains to 
be done. All of the proposed design techniques have severe 
limitations that in géneral de not edmit te pracuie] pea 
plication. ‘These lanmivaticons enavseme werepese sien ain 


proved techniques will be discussed subsequently. 


It ij 








Teo Noy es owe 


The objective of sensitivity analysis is to quantita-— 
tively predict the effect of disturbances on the dynamic 
behavior of a system. This implies the development of a 
model of system sensitivity perhaps not unlike the system 
model. In fact, this is the case. When the system model 
is described by transform techniques, for example, generally 
bhe sensitivity analysis is developed using the same tech- 
niques [10, 11, 12]. Dynamical systems modelled in the time 
domain are frequently analyzed for sensitivity by transform 
Seerators [16, 17, 18] or in the time domain [13, 24, 15), 
19, 20, 22, 23, 29]. The remainder of this thesis will be 
devoted to dynamical systems that can be described by si- 
mulcvaneous ordinary differential state equations of the form 


oie(l.1). 


A. NOTATION 
The behavior of the plant is completely specified by 


Eme diiferential system 


b(t ) 


a[x(t) ,u(t) ,q(t) ,t] 
(See) 


Eby 2) ae 


merc x(t) is the real n-dimensional state vector, u(t) is 
foe cal N-dimenamonal Comurel vector. q(t) is the real a— 
dimensional parameter vector, and a(.) is an n-dimensional 
Pector function.) in general, capital Roman letters will 


denote matrices, lower-case Roman letters vectors, and 
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lower case Greek letters scalars. Exceptions may occur in 
order to conform with general practice. These exceptions 


will be obvious. 


Bs TRANSFORM ANALYSIS 
l. Single—-Input Systems 
The completely controllable [3, 30] constant lin- 


ear dynamical system to be considered is described by 


x(t) = Ax(t) + Bu(t) G)s2) 


CC ea 


mach 1S Optimized by the control Jaw 
iGreen Sens) 


with respect to the performance measure 
Be £ (x'Qx + utRu)dt (3.4) 
0 


mere ( is a non-negative definite constant symmetric ma— 
mee. and Rk iS a POSitive definite constant symmetric ma— 
trix. The prime denotes the transpose. 

the s@olucion to this -oreblenein une ror om ascon— 
stant linear feedback control law (3.3) has been demonstrated 


by Kalman [3]. The matrix F is given by 
F = -R B'K (3.5) 


fieme K is the positive definite symmetric solution of the 


mccati matrix equation 


KBR “B'K - KA - A'K - Q = Q. (3.6) 


Wey 








Kalman [16] considered such a system restricted 
tO a Single input mec cert bcd sb 
x(t) = Ax(t) + bu(t) Can 
G0) aime 


Peeoire | 1s @ block Gdiapram of Che Suruiceure ot ents (svicwem 
This system can be represented in Laplace transform nota- 


im=oil, ILEnNoring initial conditions, by 


sX(s) = AX(s) + bU(s). (3.8) 


a 

Ire 
a am 

IPs 


Figure 1. Linear single-input optimal control system. 
From (3.8) one can obtain 
X(s) = $(s)bU(s), (3.9) 


vel 
mere O(s) — (si-A) is the Laplate transform of the funda-— 
meatal matrix. Multiplying both sides of (3.9) by f', 


yields the scalar equation 


P'X(s) = £' O(s)bU(s). 
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With N(s) = f'X(s), then 
N(s)/U(s) = f£'®(s)b (3.10) 


is the open-loop transfer function. 
The homogeneous, closed-lcop form equation for 


the system of Figure 1 is given by 
Seta) x: Cee) 


The fundamental matrix for system (3.11) is 


.(s) = (sI-A-pf')™ 


In the following development the open-loop and closed-loop 
characteristic polynomials will be required. They are 
¥(s) = det(sI-A) and ¥,. (8) = det(sI-A-bf') respectively. 


Continuing the algebra as follows 


Vey clare Cail foul) 
= ceclel A= (sl-8) (alt) bay 
= det[(sI-A) (eo) | 
Seo) lO) bee 
= det (sI-A) det (I-9(s)bf") 
=e de eles) bi) 
¥ 4s) = ¥(s)(1-£'6(s)b) 
finally yields | 
¥.(s)/¥(s) = (1-£'8(s)b), (B12) 
where the last step depends on a determinantal identity 


peoved in (31). The quantity (l-f'O(s)b) is the llassical 


eal 








return diffemence. Solving (3.12) fer i"0(s)b andes ub 
GUutineg AneonG Ome las 
¥(s) - ¥, (8) | 
N(s)/U(s) = a (3s) 
Since Q is non-negative definite and symmetric 
Beere 1S a matrix — Such thar P'P = @2 Using thes si ace 
and letting the term u'Ru = u* (single-input system), equa- 


muons (3.4), (3.5), and (3.6) can be written as: 


J = f [Gage Px) + niet eels) 
ge ONE (3.15) 

and 
Kbb'K -— KA-A'K-P'P = 0. ( 326) 


Kalman [16] proves that the K which satisfies 


mml> and (3.16) also satisfies 
-ff'-K(Atbf£") - (A'HfR')K - P'P = 0 (3.17) 
oa that: 

Paeorem a= Given a4 completely controllable con 
stant linear single-input system’(3.7) and the performance 
Measure (3.14) such that the pair [A,P] is completely ob- 
servable [3, 30], a necessary and sufficient condition for 


iecoe be a constant stable optimal control law is that there 


eolst @ Matrix K whieh satisfies the algebraic relavions 


K = K' is positive definite (3.18) 
- K(Atb£") - (A'HED'DK = Prpere’. (3.17) 
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Equation (3.17) together with K = K' is positive 
definite dimples Sic aes veble ‘COnUro aya sia 
(A + bf') is a stability matrix according to Lyapunov 
stability theory [5] 

Theorem 1 provides a relationship that connects 
fieaod Fe. However tae relavvonshi pas set easdhy sages 
preted and is certainly not very usefull as a design tool. 
Kalman continues his development and finds another rela- 
imonship between £ and PF in which K has been elimimaved: 


Adding and subtracting sK in equation (3.16) gives 
K(sI-A) + (-sI-A')K = P'P - Kbb'X, 
and 
K[@(s)] + [@'(-s)]"'K = P'P - Kbb'K. (3.20) 
Bremultiplying and post multiplying (3.20) by b'®'(—-s) and 


iieeyb respectively yields the scalar equation 


b'o'(-s)Kb + b'KO(s)b = b'd'(-s)[P'P - Kbb'K]9(s)b. 


muestitucing f = -—Kb yields 


-b'6'(-s)f - £16(s)b = b'S'(-s)P'PO(s)b - dtd" (-s)£f'O(s)b. 


which can be written 


jv - b'o"(-s)f] [1-2'9(s)b] = 1 + b'*(-s)P"PO(s)b. 
Substituting s = jw gives the desired result. 
J2 - £'¢(jw) |? = 1 + || Po(jw)b] |? (3.21) 


where the notation ||Z||* implies the quadratic form Z'Z. 
Kalman's result [16] can now be stated: 
Theorem “2sewaivemea completely Cegurollante cons. 


stant linear single-input system (3.7) and the performance 


a8 








measure (3.14) such@@iat the pair (A jPii=s Compmevel, soc] 
servable, a mecessary and sufficient tcondiilon lor civ oube 
a constant »opuamal control Law 1S Ghat. 1 asiees capt ee aioe anar 
Cee hold Toma liane 

Equation (3.21) implies) thawtior f Toliemarcon- 
stant optimal control law, the magnitude of the return dif- 


Mmaemce MUSy Dewereauer Cina Umit y sole oulllaay peers eee 
IT(jw)| = [1 - £'¢(jw)b|>1. Ge» 


times result ensures that stable control laws satisfying 
(3.22) will provide a feedback system with reduced sensi- 
Pvc les GO Variations of parameters in the plant compared 
to the same plant with an equivaient open-loop control. It 
meso amplies that the larger the return difference, the Less 
sensitive the plant will be. This is shown by demanding 
that the return difference T,(jw) for control law Lane 


pueaver in magnitude than T2(jw) for f2. That is 

[Ti (jw)/T2 (jw) |>1 C3e2s) 
will ensure that the system with control law f] Wall be ess 
sensitive than the same system with control law f>. 
Jas tOollows from 


ITi (ju) | = |wi(jw)/v( jw) | 


| (324) 
[ToC jw) | =|2(jw)/v( jw) | 


and equation (3.12). 
AlvnOuUech thts Shomer venmeprovides a means of 
evaluating various control laws, it does not appear to be 


very useful as a design procedure. If a means of finding 


a4 








the matrix Q which Savisiies the condivilews of (encore 
can be obtained, a design procedure of (practacal Utalaucy 
eould be established.) ft Seems that tum ice investigation 
Of this aspect vob Che prob Lemma gic soc hiainine tel 

Kalman's result guarantees that any constant op- 
timal stable control law for a comodletely controllable con- 
stant single-input plant which minimizes the performance 
Meecure (2,14) subject te the constraints of (2.7) will 
also satisfy (3.21). Therefore, such a control law satis- 
fies (3.22) and the resulting closed-loop system will have 
meaneed SEnsitivity when compared Co the same system with 
an equivalent open-loop Conibo lean hats acura important re-- 
muuu and adds considerable meaning to the term “optimal” 
mete tHis problem, 

Approaching the problem of constructing a Q ma- 
meox that results in an optimal control law f in the sense 
that equation (3.22) is satisfied, from (3.12) and (3.22) 
Siac) Can write 

OG) ees) Gea aL Gneb) 

and therefore, (3226) 
| 4 : ai ¥.(-s)¥, (Cs) 
[1 - f'(-sI-A) b] [1.- f£'(sI-A) bl] = —RrejyTEy7}> 


or 


a ee) - ¥(-s)¥(s) 


¥(-s)¥(s) ee (3-27) 


In the above equations, the relation 


[¥(s)]* = ¥(s)¥(-s) (32) 


eS 








which holds for polynomials with real coefficients has been 
used. In order to evaluate (3.27), using the fact that the 


pair {Aj b's completely econtrol lacie imate ss), suc 
x = Ax + bu 


can be transformed into the companion form by z = Tx. Pro- 


ceeding as follows 


Tk = TAT “Tx + Tou 


@ic 
z= Cz + du 
where 
0 ai O O 
O 0 1 
O O O 
C = 
e 1 
and 
0 
d 


DINncew ene "chacacucrisvlempoly nom al 1S slmvara any 
under the linear, non-singular transformation T, ¥(s) can 


be written as 
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¥(s) = det(sI - A) = det(si - @) 


and similarly for ¥ 6s). The control law for this system 


is 


where 
PSE A ay Rey ie ek a 
= We 2 we n 
A well known method for finding the inverse is 


expressed by 


adjM 





detM 


a 
Beene this technique yields for (sl - CC) da 


ed 


[adj(sI - C)]d 
CO) eee 


det(siI - C) 
IL. 
S 
ae 
ee ill 
¥(s) 
n-1 
S 
mieomultiplying by £' , 
n-1 n-2 
i vos + ¥Y = cial oan ol A Ct ey, 
e0 Coie) ic ei Boe i (ers 
Sto gil + O ys Stee et on 


| 








From the definitionmeos d and i one can obtain 


a 


al Or eres 
0 dense 0 eee 
Co tadi  — : : : : 
O Py a ae 
PONG Oy oo ener ea 
2 n 


and 


Since ¥ 6S) = aevtar eC ee J) aac meitonl Waist! elec 
f'(sI - C)""d = ¥(s) - ¥(s) (3.30) 
¥(s) : 


This same result is determined directly from (3.12), 
but in the present development Y¥(s) - ¥ 6S) is determined 


mgeom (3.29) and (3.30) to be 
BCS) eC S)) a= ys" > = ae 1 eee) 


Inequality (3.26) can be rewritten as 


¥,, (8) ¥, (-s) - ¥(s)¥(-s) 
Seen On (3.32) 


The numerator polynomial of (3.32) can be factored as 


¥.(s)¥(-s) - ¥(s)¥(-s) = 6(s)8(-s) (3.33) 
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where 6(s) is a polynomial, of degree at most n-1, having all 


its zeros in the left-half s-plane. Defining the Hurwitz 


polynomial 
n-1 n-2 ae 
6(s) = gs + g,-415 +...t Ey (3st) 
and the vector 
Sy 
SB» 
g = . (3535) 
ey : 


the inequalities (3.26) and (3.32) can be combined with (3.33) 


be yield 
ceo 


[lL - £'(-sI - ¢)"*a} [2 - £'(sz - oc) ta) = Gee) + 


Defining 


C2231) 
il n-l n-2 


¥(s) [gs + &,-15 faa ete eT: 81] { 


al 
f —_ = 
g'(sI- C) a ‘3 





analogous to (3.29) and substituting (3.37) into equation 


[en 30) yields 


[1 - £'(-sI - ¢)"’a] [1 - £'(sZ - ¢)" a] 

aol C2300 
LG Groen S! “Sa ieaiiat i 

Kalman has shown that a @ constructed from 


Q = ge! 
will yield the stable control law, f', which satisfies 
theorem 2 and is indeed optimal. That is, the pair [A,g] 


is completely observable. 
a 








In the above development, since the characteristic 
polynomial is invariant ewneder Praia dt ormar wor ass ee oudcmee 
Can be substituted for C and d respectively in equatieme soe 

Is the development useful as a design technique? 
Clearly it is not since constructing the proper Q depends on 
mac coring ¥.(s)¥,(-s) ~ ¥(s)¥(-s). Knowledge of ce re- 
gudres knowledge of =*°, the vector the design is supposed 
wo yield. Hence this development has little practical util- 
mye but it does pmevide comsiderad lesinsight 1nvom@he com 
plexities of the problem. 

2. Multiple-Input Systems 

The following discussion for multiple-input multi- 
ple-output systems presents sufficient conditions which en- 
sure that'a feedback system will have reduced output 
sensitivity compared to an equivalent open-loop system. In 
one development Perkins and Cruz [17] determine the suffi- 
eeeney condition for finite output errors. In a similar 
development, Kreindler [18] proves that the same sufficient 
meonditlon holds for an output sensitivity function. Be= 
cause the derivations are quite similar, they are developed 
simultaneously after appropriate definitions are presented. 

The linear time-invariant system considered is 


described by the state-variable differential equation. 


l><e 


= A(q)x + B(qg)u . (3.39) 


Bec Olany Inpuy, u, Cam be expressedwas an open-loop control 
ee a closed-loop control law that is assumed to be linear in 


xX. In order that the following comparison be meaningful, it 
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is assumed that initdal condit tons and external inpuve yaa 
to the system are the same for both the open and closed- 
loop systems. Additionally, it is assumed that any varia- 
mrons Injthe plant parateve ics mec sulic same for One 
eystvems. The objective here 1s to ensure that anyavarac— 
tions in the system output result only from equivalent pa- 
rameter variations. Open-locp and closed-loop systems that 
wabtsty tnese assumptions are considered Cquivalene systems. 
The equivalent closed and open-loop systems are shown in 


Figure 2 and Figure 3 respectively. 





Figure 2. Closed-loop system configuration. 


Considering the case where the vector g has one 
element q, the nominal parameter value is defined by q = do. 


The plant input-output transfer function is 


Co) ge ee) (3.40) 


Bal 











Figure 3. Open-loop system configuration. 


This definition holds for the identical plants of each of 
tne systems under consideration. Figure 2 and Figure 3 can 
be represented in block diagram form by Figure 4 and Fig- 
bee) 5 respectively. The closed-loop outputs and open-loop 
Guvputs are X, and LS respectively. The input notation is 


migeelozous to this. 





Figure 4. Closed-loop block diagram. 





Figure 5. Open-loop block diagram. 


Sz 








The CoOntrodsker G iS constructed such taar i om 
ce T(s,q)); sede = X(s54.). The problem then is to 
study the effects of plant parameter variations on X (854) 
and X(s5q) under the assumption that the variations are 
identical. 


From Figure 4 


X.48.4) = T(s,q)[R(s) + PX (s)] 


ee 
X (a) = [I ~ ici) al acy (se) 
ero Wtiewless 5 
X,(s,a) = T(s,q)G (s)R(s) 
or 


X (aq) = Ba)GR. (3.42) 


In (3.41) and (3.42) and in the remainder of this develop- 
Meme the functional dependence on s will not be written for 
notational convenience. 


Assuming that the perturbed parameter q is given 


by 
qa=4, + Aa, (3213) 
imaen 
T(q) = T(q, + Aq). (3.44) 
Cleary che variation of q will cause Xa and Xo ve 
be perturbed from their nominal values. Defining this per- 


Suroation as Bo and Eo for the closed and open-loop cases, 


iseespectively, then, 
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tH 
il 


X,(45) - X,(a, + 4a) (3.45) 


[I 
iW 


DOA ey) eee ci Aq) . (3.46) 
Using Ge 2 BA can be written as 


E, = (2a) - Pa) Uo. (3.47) 


Recalling that wa is not independent of q, one 


writes 


G 
OQ 
i 

ru 
= 


FX ,(q) 


St oe SIP (Cy eee COPY ome) 


S 
“™~ 
YO 

i 
cS 


Dae ee (al) = or (3.48) 


Usane equa ones (344) pasG 34S ea cicenG@o a] Om tine 


closed-loop output perturbation can be written as 


Bec.) Ue) ea aCe) 


HGP» Wea Cc teary ci Celle) 


= IGG KG) at) (3-3) 


Ea ee Uc ee Ca ae 


[I - T(a)F]” [(a,) - TMa)]U,(a,) 


[I - T(q)F]~ E 


Be 0 
where (3.47) has also been used. 

Ig Groene sion (4. iG.) T(q) depends on the. parameter 
meetiavion, however for differentially small plant—-parameter 


variations (3.49) can be approximated by 


= ene Kc ele ee (3.50) 


EF; 
=—C O 
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This is the central, result oie |.) -Cbservaiae 
a 
that T(q,) = [sI - ACa,)] Bla.) = 2(s,q,)B(q.) and substi- 
PGi into (3450) yards 


E, = (I - (s,q,)B(a,)F]” EB, - (oa) 
The term [I - ier cee Cclpy 2 in (3.,51)) sees senile 

to the scalar return difference and has an interpretation as 

the generalized matrix-return difference [17]. 


Kreindler [18], instead of defining an output error 


mmret ion, dekines a sensitivity function 


WOE = ee Ow 7 ele ALi Cie Ne (3.52) 
ayo|al0, 
and 
v(t) = 3x (t)/9q BP me e,(t)/Aq (32.587 
Nelo: 


where the Laplace transforms of V te) ana 
tors VCs) and se respectively. With these definitions, 
the following relationship between V(s) and V.(s) is ob- 


tained 
Vee (= Osrqe)E(q. ) ilies) 7 eee) 


Before expressing the conditions under which the 
system sensitivity is reduced, it will be convenient to de- 
fine a new sensitivity variable which under the proper con- 
Grbions represents either v(t) or e(t). The new output 
sensitivity variable y(t) with Laplace transform Y(s) is 


defined such that 


Y.(s) = [I -8(s,a,)Bla,) FI” ¥o(s) (3.55) 


or 


I 


es a GCs) 


= 











e output sensitivity is the weignted 
Using 


A measure of th 
aoe the Se 
100Pp system 


alent open 


m of the sntegr a ee squared. 
will nave reauced sen- 


su 
wae closed- 


ween 
100p system neg 


this meas 
ivity compared to the equiv 


oO oO 
1 
| of ig J y 


0 
oN gefinite weighting ia 


e Z 1s a post 
ton (3.56) implies 


eu 
W(t) ZL (HGF » (22) 


all t >0, wher 


ror 
trix: Using parseval's theorem » equat 
co co 
.. Se Pes 
| ae sayaz,swaee| YM ju) ZY 05079" 
— moo 
which is equivalent i @ 
Cc 
| x (gu) tS" (Jo) B8O" ie (jw) dw<0 (3.57) 
— OO 
Tnequality Goo will hold a 
Z <0 (3 a5e) 


gt (-ju) 2805") - 2 
for all > where S(jw) 4s tne inverse of the return Cala 
premultiplyiné and postmultiply+ne (3.58) bY 


ference: 
ively yields 


(s'(-Ja) 1 and aa. respect 


ees 
joie that any 


scion (3- 57) 0 


ed sensitivity 


Ae resul 


seo!) will 
sn the sens 


ptain 4 measure 


e of (3.56) - 


es ecalae = cond 


em Wie Suane 


ed 


pack syst 
sntegrated Oe 


56) can be il 
ivity reauction - 


Nevertheles® ; nese 


e integrals ce 
ount Gs sensit 


) and (3.59) 3 


eta 
piece. 
provide no hints about how to 


Cen 


conditions » 
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Gesign systems having reduced sensitivity. They might be 
useful in trial-and-error design but that is not very sat- 
isfying. 

in a development similar to Kalman's [16], Perkins 
and Cruz demonstrate that the control law F that satisfies 
condition (3.58) is optimal for single-input linear time- 
invariant regulator systems with respect to the performance 


Meaollre 
J = sf [x'(t)Qx(t) + w2(t)Jdt . (3.60) 
0 


Kreindler [18] proves the following: 
Theorem 3. For the completely controllable single- 
maput linear plant in companion camonic form, for seach com-— 


Memeenb Y , 1 = l,2j;u%..n,"of Y, the fol@evinethclas 


Y2(s) = [1 - £'0(s)b]¥3(s). (3.61) 


If in addition f and x = Ax + bu are optimal with respect to 


/mro0), then, for all t,>0 


J 


This is a useful result. However as Kreindler 


Cy Cy 


[y,(t) ]?dt < J [ye(t)]?at, (3.62) 
0 


: ali = ale Pe earerns Tics 


fe) points out it is only applicable for systems in the 
eompanion canonic form. 

The analysis techniques discussed above are exempt 
from a restriction that the analysis techniques discussed 
subsequently have almost universally: there was no identi- 


fication of the parameter q made, hence, any and all of the 


SH 








variable plant-parameters will exhibit reduced sensitivity 


when the conditions for reduced sensitivity are mev. 


Cr. STATE TRAJECTORY (Sensi iia 

In generals a plant which as sensitive £oO perturb apven| 
of its component values may be characterized in the form of 
equations (3.1). In the sensitivity analysis of such a sys- 
mel, 1b 18 necessary to relave numerically the dispersion 
of the solutions of (3.1) for varying values of the para- 
Mevers, q. 

Although a great deal of work has been done recently 
am the area of state trajectory sensitivity, few important 
general results have been discovered. Most of the design 
meemniques that are discussed in the literature result from 
application of the sensitivity equation [6, 13], obtained 
by taking the partial derivative of equation (3.1) as fol- 


lows: 


9 (CX) _ 2 
oa, a “9a, CG Cer a Carry | 


ax 0 . 
0. Ae = ore eee ae 
00s OG dX : 0 


The form of the matrix of partial derivatives, Jay o Creel sacle 


oo een) 








! 


1 
Qo 
~ 
@ 

1 

Qos 
OyIS 
Qo] @ 
Wo l1p 
Qo 
CO 


Q 
OQ 
J 
! 
! 


fined by 


0a. 
a0 


ij HEL a Saelhse See. 


> 


e > 
Il 
ve 


(GRE 





elias 


The matrices da/dx and da/du are dimensioned nXn and nXm 


respectively and are defined in a manner analogous to (3.64). 
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Thestorm of the. Vvecteore sot  pamena I MGdermvoraves., 9xX/9q, > is 


Gle fsic Cluny, 
OX, 
ods 
OX 
= = (3.64a) 
0d 
OX 
_ 
oq. 


The vectors su/dq. and 9q/93q. are m and r-vectors respec-— 

tively and are defined in a manner analogous to (3.64a). 
ee 9x/9q. ax/ot, and oX/9q, are all continuous func- 

meen of G and t, the order of differentiation can be IMs 


terchanged and 
. i a . | 
oe ae me es Ewes _ (3.65) 
aq, Gls aig aq 


The sensitivity function (influence coefficient) s,(t) 


is defined by 
ax(t) 


s.(t) =; 
x 3 qs 


for all x and q,, (3.66) 


Deel. OC ceed? 5 


Usime equation (2.6%) and definition (3.65), equation 


(3.63) can be written more compactly as 


| 99 


dU Ja dq ? 
"a; * 3q * Fay — 








Ja 0 
ax ° 


Ly 
Q 
1c 


SiLMmcee tne SseCl LON ols Was "ShOWUMN then 1ecdoaen cOmmmco 


frequently can provide reduced sensitivity over the equivalent 
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open-loop system, it is assumed that a control law of the 


l@ ih 


eee | (3.68) 


i Speci tuced. imder erie va couniy eased du/ dq. Can De Wiribven 


as: 





= : oe = 3x sae (3.69) 


Using (3.69), (3.67) can be written as 








Rewriting (3.70), where the meaning of A,(t) and w(t) is 


Soy1OusS, yields 
( 
S,(t) = Ay(t)s,(t) ot w(t), 1 = yee ae 


Lo 
—] 
Ld 
wy 


Equation (3.71) is the vector notation for nr equations each 


having the form 














OX. Ja. ox da. du 
dat ods k=] Xp od. k=l gQ=1 Up xy 
aX r .0a. oq 
a = nace ae : eae 
eT qi ot 
i Set Aaa, “Salk 


where 9q,/ 9d. = 
O otherwise. 


In several equations above for convenience in notation, 
met lon arguments were omitted. This practice will prevail 


Paroughout this section. 
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Since it is assumed that the parameter variations mauc 


noe ef féctison the indie nai conc ewoOMe set) ssa la 


S,(to) = Q. (3.71b) 


In erder Vo Obtain the sensitiviry funcvlonmadewudedan., 
Mee(l), the valves for Ay(o) and w(t) must be determined. 
This amounts to evaluating the partial derivatives da/odx, 
Bie/oc, da/au, du/ox, and 9q/9q. . This can be done for the 
specific optimal control problem under consideration. 

ciesour ima eeconurol 15 the admissib les conuy role, Us Cea 


men causes the system 
Bs Gy) ne Uy) Gua enc Gc gata (cree 
KU was 1c 


to follow an admissible trajectory, x(t), that minimizes 


Gime cost functional 


iy 
f 
TS 1bXe steal At Fix (euler mae aie) 


Y 6 


fee tCransterring the state of the system Trom @ given i1ni— 
met position x{to) = ¢ to some final position x(t p) = Xp; 
m@mat 1s restricted to some (n + 1) dimensional subset T of 


Zao pines s poco | focal led the tarezer sev. “Here. sence 


Souimal control is constrained to the feedback form 
u*({t) = u[x*(t)], (3.73) 
Waele US and X* avenunonopermal Gonrrolmand™ UrajieCUGiny snes 


spectively. 
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Returning to consideration of the partial derivatives, 
da/0X%, da/dU, and) a7 eG are sae i iuncL tons (Of Bic uae 
q(t),t]. However, using (3.2/3). the expaicit dependenceman 
u(t) can be eliminated and then the partial derivatives be- 
pome functions ci [x (a)satu) jbl. the vyelue gic) esac 
defines the point in parameter-time space at which the par- 
tial derivatives are to be evaluated. Additionally, it is 
noted that du/dx is also a function of x(t) and therefore, 
meecause Of feedback, implicitly a funetiion of q(t). Upon 
meecitication ©f g(t) the differential equations (3.71) wih 
their initial conditions (3.71b) can be solved for the sen-— 
pee ivicy function, s,(t). If small parameter variations are 


assumed the partial derivatives can be approximated by let- 


> 


tine = Wine lere Oo yrepresenus the eG ine Pa aS ee 


I 


It would be well at this point to summarize the devel- 
epement . 


HOt bes yiecinec oy a Gem 
CCI = Ollesee) su ieciGt)) a | (3.2) 
X(to) = Cw. 


Emer OplLimal control 


u[x*(t)] (3.73) 


Pe sG) 


minimizes 


t 
te 
J = h[x(tp) tp] f F[x(t) u(t) ]dt. (3.72) 


t 
O 
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The trajectory sensitivity with respect to the para-— 


meter qs is 


dx(t) . 
s,{t) 7 9g, for all x and ie so oe (2c) 





and is the solution of 





SECs en Crs Gcs) emer @t yr o> 
where 
| sa 3a au 
Ai(t) = ee (Ser) 
= wee (Gnas 
and 
da dq . 
w(t) = aq "3a, (3.475) 


Q=do- 


Chatwand Chvans aieths sl Ob Gad med esd de lone UM mo.) 
Eepanding the right-hand side of (3.1) about [x,qo0,u(x),t] 


mia Lirst order Taylor's expansion. They obtain 


cla Cliee S  (e ih ae Is Zee) (35 71) 
ACO ae 
where Ze = x? - XE is the ith eemponent of the variation 
eerongez the optimal trajectory, and Ys = qd; - Bao ee le 


Variation of the parameter ar avout spo nem naw vaiine Eine 


Matrix A,(t) is defined as in (3.74), B(t) is 
B(t) = da/dq, (3.77) 


and the partial derivatives in (3.76) are evaluated along 
wae Optimal trajectory . 
Writing the ith equation of (3.76) in expanded form 


yields 43 








az n da. m 0a dU. 
ae) a eee cae 2 
at k=1 aX L= i ou aX k 
k Q k 
iia (3.78) 
4+ 0, a4 y 
k=1 9d) k 








a (x. - Key) _ n da. m 0a, . JU, | 
dt Y K21 x i pe du ox 
1 k Q k 
bet el es (3.79) 
Ys ee 








d One Ja 0a. Ju x 
a oi] op Pay Fay Oy | 2x. 
aie Oe Moose oT Kae oug es ; oar 
L 
i dae dq 
ae) 
di Ts 


maaren is identical to equation (3.71la). | 

fgets important, to Meuwe tUhagethe Sensitieyity equarvion 
derived above is always linear; this is true even though the 
dynamic system (3.1) may be nonlinear; therefore, equation 
(3.71) is always a system of linear ordinary differential 
Bomauions with constant or variable coefficients. It should 
malso be noted that (3.71) is not valid for the case in which 
fecal Vary in such @ manner as to change the orcer of the 
state equations [8]. In most applications the parameter 
vector, q(t), is assumed to be a slowly-varying time func- 
tion that can be approximated by the constant parameter 


MeCvOr s°d:; 


Wy 








iw Linear Systemes lates lka | eCvorny eis 10 ia, 


In this seetion the state trajectory analysis 
above will be applied Go a linear stave resulavor jcysvucm, 
The results of this development will be used extensively 
in following chapters. 

The linear regulator system is described by the 


swaLe equavions 


GG = wh Cong) Cte ict cp iuncey (3.80) 


with a linear feedback control law of the form 
me) wc) inn (3.81) 


ACU iss the realy ey ime—[ Vary mem sy Ss Verma alewaine 

B(t) is the real, time-varying, nXm distribution 
Ma Ute, 

F(t) is the real, time-varying, mXn gain matrix. 

u(t) is (he control m=Vvector. 

x(t) is the state n-vector. 


q TS eve sCOnS Vell par aer GG Ct. Oi. 


Assuming that the solutions to (3.80) are analytically de- 
mencdent on the parameters q, the partial derivative of 


(3.80) with respect to parameter qs as 


Cece) 
d OX JA OX dB du 
—- |o— | = x— Xt A amt aut sBrz 
aie oq. qd; = = ods Od = 0d; 
Merining, as before, 
ax 
=i ~ 3q, ° G38.0.3)) 


4G 








and using (3.81), thessensitiyuty sequattem (3.02) mean. 


written more compactly as 


du 


S. = OA. X + oBeuU + AS; a= B oq, ; (2234) 





Taking the partial derivative of (3.81), where it is assumed 


that F is not a function of qs» yields 


au 


=e sco) 


ods Set 


Using (3.85) another useful form of (3.82) is obtained, 
Ss, = [8A, + 9B,F]x + [A + BF]s, , Cor ele ) 


where the meaning of OA. and 0B. is clear from (3.67) and 


noe). 


=~ — Se ee 


De PERFORMANCE SENSITIViITY 

In a design procedure in which the ideal controller is 
optimal for a wide range of parameter variations, Rohrer 
and Sobral [27] define a new sensitivity function, the 
Bgedative sensitivity’ of u(q,t) at parameter ‘operating 


pemmt' gq. This relative sensitivity is expressed by 


r eu, Op = Sue oe 
ee uae Ep , Gro e 


bere Us(q,t) is the optimal control such that 


de Uy mea Guay) (3.88) 
u 


euoj;ect to constraints 


Gey eal Peco In UGch, Gxt ah, (3.1) 
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Among the advantages cited for the use of such a per- 
formance sensitivity is that it is always positive. Addi- 
tionally when. Lnempar amorero sO aren UCms Liar anne 5 no) on 
This provides a measure against which system performance can 
be compared. 

The design technique proposed consists of a minimaxi- 
mization of the relative sensitivity with respect to u and 
fae ene procedure Consasvs of assuming a désign criveria 
which defines the plant sensitivity SP(u). Two suggested 


plant sensitivities are 


SP(u) = max ; S*(u9) (3.89) 


and 


CQ 

cc 

a 
Ig: 


(3.90) 


[rere aay 
CA 
BS 
o~ 
Ic 
Ne 
I.$2 
Ww 
ot 


LO [rx 


where E [+] indicates expected value. The design procedure 


then consists of choosing u such that 


U 


SP(u) = min SP(u) Ge 
In a second-order example with a single variable parameter, 
Rohrer and Sobral demonstrate that the use of "relative 
emoitvivity™ in conjunction with (3.89) yields a system that 
has reduced sensitivity and remains close to the optimal 
weer eviie Cnvire france of parameter variations. 

Salmon [28] presents a new algorithm for the global 


solution of a minimax problem. The algorithm converges to 


the global solution in the presence or absence of saddle 


a 








points. The class of sopvimizati on problems fer Whale eae 
algorithm applies includes those having quadratic perior-— 
mance measures with linear time-invariant state equations 
and a constant gain linear control law (the infinite inter- 
val problem described by Kalman [3]). 

In two examples, Salmon applies the algorithm using 
the Rohrer and Sobral "relative sensitivity" and the "abso- 


imice sensitivity ," 
Dee ease Cle ae ees ere ae (3.92) 


ide each . 

In the first example, which is the same as that used 
by Rohrer and Sobral, the performance using "relative sen- 
sitivity" exceeded the cptimal performance by less than 1.9 
percent for all allowable values of q. The performance 
using "absolute sensitivity" exceeded the optimal perfor- 
mance by about 50 percent for q = 0, the minimum allowable 
Meawue of q. 

iiethe Second example, ume control obj JeEevive 15 vo 
Maintain the spacing among a string of three electronically 
coupled vehicles. The five state variables are the three 
Pombecte velocities; and the two Spacings between the center 
and end vehicles. The performance measure is the infinite- 
time integral of a quadratic form involving vehicle spacing 
Seriations and control. In this example with nine variable 
parameters, the "absolute sensitivity" technique provided 
Periormance closer to optimal than did the "relative sensi-— 


tivity" technique. This was to be expected since it is more 
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important that. the controller be ciLose Lo ideal ween see 
per formance measUne se) Gund). aehomecdtcl c= 

Another feature of design techniques using "absolute" 
or "relative" sensitivity is that the ae ee of the con- 
troller must be specified by the designer. Hence, the 
technique is amenable to solution of the de-sensitized out- 
put regulator problem. 

The minimax design technique, whether using "relative 
sensitivity" or "absolute sensitivity" apparently has ad- 
vantages of considerable value to the designer. However, 
there are also disadvantages. ae algorithms are dif- 
ficult to implement except for restricted classes of prob-. 
lems. Additionally, the solutions obtained are dependent 
Seeeene initial con@ation: mence, the solution is only 
waa fOr that initial condition. In-general, the solution 
obtained by minimax design will be optimal for only one 
ictal condition. 

aren [34] applies a minimax algorithm to the solution 
Siecne Output regulator problem. He defines an auxiliary 
performance measure which takes the forms (3.87) and (3.92) 
among others. With a second-order example he demonstrates 
that the controllers obtained by the two methods differ 
widely. The problem is solved for several initial condi- 
tions and is used in an excellent discussion of the effects 
of initial conditions on performance for several auxiliary 


performance measures. 
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Ine SUMMARY 
In Kalman's development, it was shown that for the 


eompletely controlliab Vera mae lew pies lane 
Ge, mes God) east) Cap 
and performance measure 


oO 


J(u) = | ea ora ae et Ce) 


0 


the optimal control law 

ye(t) = £'x(t) (3593) 
Bewisties the condition 

[ee era) on, anes P22) 


MemalsO proved the inverse tneorem: if a staoie convroL 
iwessatvisites (3.22), then 10 is optimal for a peritor— 
mance measure (3.14) with some Onn) Canvie 1 setter] SOMe Se ariat tiie 
Seo by Spectral factorization of a rational function. 

Poe rnpOnt any eecull seth every Optimal system (or 
Paemernorm Of (3.7), (3.14), aimd (398) will exhibit reduced 
Sensitivity compared to an equivalent open-loop system. 


Pel elnicmanic er lizmdet tied cmc head vay lb vam x 
=I 
S(s,q) = [I -9(s,q)B(q)F]*. 


The inverse of this matrix was interpreted as the generalized 
matrix-return difference. Their central result was that con- 
meant Teedback control laws, E, for linear state regulavor 


Pesvems (S559) that savisiy the condition 
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S'(-jw)Z8(ju) - 2 < 0 (3.58) 


for all w, wi Tae provide s-ecaduce@ eur pul Ermer Conpereadsre 
the equivalent open-loop system in the sense that an inte- 
eal inequality Joh sthe ype. (sen G) aye laolld hO 1 uae Or 
Kreindler with parameters restricued Go ditierencgacimi:, 
small variations obtained the same result for the output 
sensitivity function (3.52) and (3.53). He also showed 
tnat for systems in the companion canonic form satisfying 
3-50), the sensitivity measure (3.56) reduced to the form 
Pamecso2). Enis result implies that the sensitivity of caca 
State trajectory in the closed-loop system was less than the 
sensitivity of the SomeCo pence open-loop state trajectory. 
state trajectory sensitivity analysis was approached 
by means of Ge seneitiviectcy Lunetion Gefined byw liler and 
Murray. <A sensitivity differential equation was derived 
which was linear even though the system model could be non- 
Hinear. The sensitivity differential equation was made 


explicit for linear state regulator systems as 


JU 


Rohrer and Sobral introduced a new "relative sensi- 
tivity" performance measure that defines a minimax problem. 
mae Lechnique 1s applicable with large parameter variations. 
Saumon provided a minimax algorithm that could be used vo 
solve problems using "relative sensitivity." However, by 
means of an example he demonstrated that for some problems, 


better results are obtained by using "absolute sensitivity” 


ee 








for the performance measure than was obtained using "rela- 
tive sensitivity." It was pointed out that the dependence 
on initial conditions severely Limits the weilivy or Seneoe 


minimax schemes. 


Be 








LV SERA ECTOR Me Sh Saar 


A. GENERAL PROCEDURE 

In the previous chapter, an expression for the tra- 
meCCOry Se€nNSivivity of a @eneral feedback system to planp— 
parameter variations was developed. In this chapter that 
expression will be used in the development of an optimiza- 
mem problem that includes Sensitivity constraints. 

The objective is to use the trajectory sensitivity 
analysis technique previously established in formulating an 


Socimizacion problem that will result in the design of con-= 


trollers that are optimal in some sense and at the same 


time provide trajectory insensitivity to plant parameter 


Gisturbances. 


EGquar2ons «3466. 


(Bee mies.. (ean Csi ib me roma 


peated here for convenience: 








ax(t) 
3702) a q, elon (aca) 
s.(t) = Ai(t)s.(t) + w, (6) Gri 
S,(to) a! 
0a Ja ou 1) 
Ci Saf 
dx du ax a=ao 
aye (3.75) 
we(t) == ° 2S 
: a4 895 fa=ac 


DS 








By adjoining equation) (3./1) tosequauton (3.1) tre mG.» 


augmented state vector z is 


x(t) 
Ss ,(t) 
z(t) = (Jee) 
s_(t) 
tae corresponding initial condition vector is 
c 
0 
Z(t) = (4.2) 
0 
The augmented system then is defined by 
EPSGty eugc shar). a 
A) Shem) 7 Ot) 
Zee ee (4.3) 
Ai(t)s(t) + w(t) 
eremore compactly as 
Cay 
Z(t) = d[x(t).si(t)....s_(t),u(t) g(t) wilt)... (t) 6). 


Following the procedure of Kahne [19] a new performance 


measure that includes a scalar sensitivity term 
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(4o5) 


ie 
if 
J = nixed stots f [E(x a) g(a (ee ea 
ie 
O 


is defined. 
Applying Pont ryaicin! seminar eo Vee 2 lean la 


Hams ltTonian is given by 
H[z(t) u(t) p(t),q(t),t] = (+) + gl) + ptal+), (4.6) 


mm@ere D(t) are the Lagrange multipliers. 
The necessary conditions for unconstrained u(t) to 


minimize the performance measure (4.5) are 


2¥(t) = 22 [2k(t),u*(t) p*(t) q(t) ,t] 
p(t) = = 22 [2*(c) u(t) ,p#(t) ,g(t) ,t] (4.7) 
dH 
0 = 2S [2¥(t) ,u*(t) p*(t) q(t) ,t] 


for 2li1 t stst Winhewent. loertaced ond x(t ,) is free. The 


fe f 
superscript (*) denotes optimal. 

Hietk&e 1S NO Suaramvec taal a SOlutsOn TO the above 
meeoplem exists. 

Considering the performance index (3.72), the con- 
meoller obtained above will We, suveneanads A tradeoff be- 


tween optimality with respect to (3.72) and sensitivity 


Mmeaquction will actually occur. 


i. LINEAR REGULATOR SENSITIVITY DESIGN 
In the preceeding section an optimization problem was 


defined and a method of solution outlined that resulted in 


DD 








a control that was optimal in the sense that a performance 
measure which included sensitivity terms was minimized. 
where is some question Concerning The existence vol sonee one 
bon proposed. In this seevwen the procedure wi lispewsae— 
pled to the linear repulator probiem. The solution ao 
this problem exists and can be obtained following the for- 
mulation of Athans and Falb [4]. 

The linear time-varying state regulator system is de- 


imed by 


enc Pe et cay nee) (4.8) 


CG) =e 


I> 


Rewriting equations (3.83) and (3.84) here for convenience 





OX 
ae 4 = 1.9 1” (2,83) 
ne 3 a a 1 Vue / 
al. Od 
: du 
S, = 0A,x + Buu t+ As, + B 5a, ( 3mee)) 
s(t et) 
iMieernavector s is defined by 
Ei 
Ss = ; (4.9) 
S 
=r 


The partial derivatives are evaluated at do? the nominal 
welue of q. (Function arguments have béen dropped for no- 
tacional convenience.) Helena? 8 GO nN 3. Ce) Pancmes 704. 


Che matrices OA, and OB. are defined by 
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and 
aB 


Higginbotham [23] writes the vartial derivative of 








u = u(X,81,S82,.-.S8,,,t) with respect to q, as 
du dU Ox r ou ds. 
aes =| = ® = zen a . = e (2s lies 
oq, 9X = 9q, Fl WSs oq. 


du r ou ds 
ey oA, x + (A + B ax | 84 * sBsu +B 5k, 35, aa, 4 1%) 
or 
S, = 0A,x + As, + dB,ute, . (4.14) 
=i -i- ~~1 -i- =1 


It has been assumed that the resulting controller will 
be a feedback controller of the states and sensitivity 
funetions. This result will be demonstrated. It has been 
further assumed that the partials du/dox and ou/ 9s are 
seoluated at Q=9,° 

Proceeding as before, equations (4.14) are adjoined 


to equations (4.8) to form the augmented system 


x A 0 0 - 0) (x B 0 

31 aA, AO L = 9B 25 

S2 aA, 0 A 0 S 9B 

—-——— oc ee, Tk pes 4- 7 u + — (4 Sp 
3A 0 0 A Le 

=o a 2 BP NS Sy By e. 


a 








which can be written more compactly as 


b= Ayet+ Bute (41.16) 
£ 
0 

ci = ie 7 
Q 


migcre the meanings of Zz, A 


—l? 


Brand: =e atce OL e aioe f omee enone 
The quadratic performance measure, J, is 
se ee a cD Ge) cc scar) 
Bs (4.17) 
+ | [x'(t)Q(t)x(t) + s'(t)W(t)s(t) + ul(t)R(t)u(t) Jdt 


C 
O 


where the terminal time t, is specified and 


it] 


is a constant rnxXnr positive semidefinite matrix 


iO 


is a constant nXn positive semidefinite matrix 


1 


(Coes chan pOSsibive semmderintupes marr x 


I= 
o~ 

ct 
Ww 


is an nrXnr positive semidefinite matrix 


and (t) is an mXm positive definite matrix. 


i 


The performance measure (4.17) can be rewritten in terms of 


Z as 
t p CA) 
Jo= *z'(t,)Diz(t,) + “f [z'Q,:z + u'Rujdt 
c 
O 
where 
Di 0 
D, = = Er oa Garde) eh geal sal Cust g)) 
ae. = 
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and 


anne in (ps2) aX( r+ in. (4.20) 


By applying Pontryagin’s minimum principle, the neces— 
pemey and sSsuificient Condavions for the eptimal control are 
Sovained. 

ihe Hand beontan ils for (4eelo) sand (4 ie) fomcdeta med 


as follows 
H= % [z'Q,z2 + u'Ru] + p' [Ajz + Bute} (4.21) 


minere p(t), the (r+l)n costate vecvor, satistiies the dit— 


ferential equation 


oH 
= - = Cio? 
p 2 ne, 
ong 
p BS AS Gee) 
The unconstrained optimal control must satisfy the 
equation 
=O (4.24) 
du ce 
or 
Rue Baie 0 (iy 25) 


f 
1 
Solving (4.25) for the optimal control yields 


u®# = - R''B'p . (4.26) 


in ender nee 6 XpreserU sea Unc opecwemed 1 OLm OigPcdta. 


mica (3.01) cubctitucame (4.26) incvo’ (4.16) yields 


= A.z- BR Byp + ¢ (4.27) 


INe 
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which when combined with (4.23) forms the augmented system 


ctl <a gl | apigeateamiaae es aac) ee (4.28) 


We 
I 
& 
| 
= 
"Oo 

© 


This is a system of 2(rt+1)n differential equations. In 
order to solve them, 2(rt+1)n boundary conditions are re- 
quired. The first (rt+1)n boundary conditions are defined 


by equation (4.16) 


Z(to) = <--- (4.29) 
of. . 


The remaining boundary conditions required are final 
conditions for the co-state equations. They are obtained 
from the transversality conditions (see Table 5-1 of [4]), 


with fixed terminal time, tes and Z(t.) free 


3 
GC ere ea, Dy) 
Bi ate Co ieee (4.30) 
or 
Cre Dr Cass 
The solution of (4.28) at time t, can be written as 
Ce) 
Z(t») z(t) tp e(t) 
---=- = o(t,,t) ---- + o(t,T) ------) dt, 
p(t,) p(t) 0 
ie 


where $(t,,t) is the transition matrix for the system Coops 
Parti tl omne o(t,,t) into four (r+l)nX(rt1)n submatrices 


yields 
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rhe nae 
® (isi) ee ee 1 ae ee Cr) 
Ome ha ah) 
Substituting (4.31). intos@ ace acid. 
z(t) 
cee (4.34) 
p(t) 
$45(t,T) e(t) 
—-------+---------- ) ¢ ----- ag 
Co, 0 
Paeeornuns the indleaved matrix multiplication yields 
- (4.35) 
4) en) Mama or Oo ee Patt, c) em 
Moe SE 2 ye ae eee. -ll- 7 = eee 
ee 9512 4 PooP $5,(t,t)e(t) 
te 
Pemnorming additional algebra 
UE 
POs Saige | ‘f Des eo 


T 


ic 
a . 
= 9512 ay P5oP ‘f eee 2 er 
G 


ere ee See ie ©? oa 


bef | we 
f Di o17(t,t)e(t) dt -f do, (t,t)e(t)dt 
iE % 


iol 








yields 


p(t) = [Poo(tpst) - Dydyaltpst)1™ + 


oe (33 oy 
fiosbaylt getdate lect f [Dy $1 (657)-9 5) (857) Je(4) ae) 
t 


Equation (4.36) is the desired result; it relates pv) 
and z(t), and with (4.26) yields the optimal feedback con- 
troller. Kalman [3] has proved the existence of the in- 
verses in (4.36) for all t, tos<ts<t,. 

Writing (4.36) more compactly 

DC C)m> KGa ty vate) (4.37) 
mameaesuostituting into (4.26) yields the optimal control 
—a 
u*®*(t) = -R (t)By(t) (K(t)z(t) + v(t)] (4.38) 


where (4,39) 


and 


(4.40) 


T 
fr 
| [D, $4 (#57) — $5,(t,t)J]e(t)dt. 
T 


Since (4.39) and (4.40) are extremely difficult to 
evaluate, a simpler expression would be helpful. Again fol- 


lowing [4] the time derivative of (4.37) yields 


p=Kz+Kz+v. (4.42) 


— 
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From (4.27) 


Za Zee pac Cae 
Wiveie 

M = BRB! (4.43) 
ema from (4.23) 

iS ena nee (4.23) 


Bepstituting (4.37) into (4.41) yields 


2 = [a 2 ive Ce 


Siostaituting (4.43) into (4.40) yields 
p= (Kk + KA - KMK] z- KMv + Ke +. (4.45) 


emigscituting (4.37) into (4.23) yields 


Fa a a ae os 
L = J 


1 Be 2 ae ee ° CP Ga) 


lk 


D 
Subtracting (4.46) from (4.45) yields 


@ e CARAT 
[K + KA, - KMK + AIK + Q,]z + ¥ + [AJK - KM] v + Ke = 0 


If the optimal solution exists, equation (4.47) must 


ime FOr all z(t), v(t), e(t) and t. Therefore 


K(t) = - K(t)A,(t) - AL(E)K(t) + K(e)M(E)K(t) - Q@, (4.48) 
and 
w(t) = - [A'(t)K(t) - K(t)M(t)] v(t) - K(t)e(t) . (4.49) 


The boundary conditions for (4.48) and (4.49) are found 


as follows. Equation (4.37) evaluated at t=t, yields 
Dees Con a(t) tauCl (4.50) 
Equation (4.31) is repeated 
p(t,) = Dyz(t,). Cis) 
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Since (4.31) and (4.50) must hold for all Z(t); at 


follows thar 


K(tp) = Dy 


and 


O (4.52) 


v(t ,) Vv 
Having obtained the desired control law (4.38), the 
partial derivatives of (4.12) can be further evaluated. 


Pertorming the multiplication indicated in (4.38) yields 


—1 
UPS > Be Py iKyk * Rosy foe Kee 


ae (4.53) 


where the matrix K. is the it? (r+1)nXn column Paw tion of 


meee partials Oi uU with respect vo x and = are 


gu/dx = -R'BIK, (4.54) 


and 
or (4.55) 


heseectively. 
iteswould bewneted thay thas result inplies=tnac the 
matrix A,(t) in the Riccati-type differential equation (4.48) 


Pemeains elements of K(t). That is from (4.15) 


~N 


A(t) = A- BR B'K,. (4.56) 


Thus the optimal controller utilizes state variable 
and sensitivity function feedback. An additional forcing 
Mim@esbson, v(t), that might be considered the Sensitivity of 
Feemesecistoiy yy LUnCUHOhewlSs cise. an 1npul. 
Figure 6 is a block diagram of the system with its feed- 


back controller that results from the sensitivity-constrained 
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Figure 6. Block Diagram of Sensitivity Constrained 
Linear Regulator System. 
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design procedure derived above. It is clear that the deriva- 
tion yields an extremely complex control strategy and any 
simplifications that can De Made sweulos be (ex ¢ remedy Sd esangaolker 
Figure 6 assumes v(t) and s(t) are available, they ici CO ds 
course, be synthesized. 

The sensitivity vectors can be generated from the vec- 
tor differential equation (4.13) with the state vector and 
eomnurol vector as forcing Tunctions. However, the open—locp 
mMpuG v(t) is not so easily generated because the initial 
conditions for equation (4.49) are unknown. These functions 
depend on the partial derivatives of the Sensitivity vec-— 
tors with respect to qs» the unknown parameters. The solu- 
tion of (4.49) then depends on x(t) and hence is dependent 
ome initial Bondi tons.: Consequently v(t) must be computed 
Geeetine tor the desired trajectory, x(t), and can be used 
emy ior that trajectory. 

The controller described cannot be implemented in the 
linear regulator system in which the initial conditions are 
unknown. In order to implement it for a system with the 
eajeccrory, x(t), v(t) must be determined off-line by solving 
a two-point boundary-value problem COnemist 1 Ne Ome 2r+ on 
first order differential equations. Even though the equa- 
tions are all linear, this is not a trivial task. 

in the =f ollowine ae edonsy two design techniques that 
are simplifications of the above are considered. The first 
due to Cassidy and Lee [22] neglects the e,(t) term of equa- 


tion (4.14). The second due to Kahne [19] assumes the matrix 
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B(t)»is not a2 funct ton gemma: 


the entire term su/oq, iinmequat tons Gsmotyre 


Ge THE CASSIDY AND LEE COND@ROL STRATEGY 

Cassidv and Lee [22] presented a new 
derived from an optimization problem that 
meaquction of trajectory dispersion due to 


wartacvions. 


Kahne also completely neglects 


control strategy 
considered the 


plant parameter 


Their development was much the same as that of 


section B except that they neglected the effects of the 


term e(t) in equation (4.16) and considered only the case 


where there is a single input. 


ine die Vice Subir Ss. 


extended to 


multiple inputs, are presented here as a variation of the 


development of section B. 


ie 1 neat sine -Vany Ine stale sresulavor oy over wcedes 


memed Dy equation (4.6) with ivs 


x(t) = 


A(t,q)x(t) + B(t,q)u(t) 


accempDarpyanc delinitvions 


(4.8) 


aime Sensitivity funetions and “eguatthens cmmehapter 


mebare repeated here for convenience, 





S, = 0x/dq, 
and 
S, = 0A,(q)x + A(qg)s, + 0B, (q)u 
$5 ft) aa 
Hider e 
9A, = dA/2q, _ 
16 
By = OB/2ay | 
146 





(3583) 


cae du/oq. (3.84) 


(4.57) 


(4.58) 








Anticipating the tesultanewconuroller sult) 1s sdetinee 


by 
u(t) = F(t)x(t) + 42, F,(t)s,(t). (4.59) 


Writing the partial of u(t) with respect to qs and 


ignoring second partials, yields 
su/dq, = F(t)s,(t), (4.60) 


woere F(t) is not a function of qd, - 
Substituting equation (4.60) into (3.84) yields the 


sensitivity equation used by Cassidy and Lee 


Ss. = 9A.x + (A + BF)s. + 0B.u (4.61) 
= -i- - —-“*=j -i- 


Ss, (to) Sere 


heain Lune rion arguments, once specified, are dropped 
ite nmOLational convenience. 

PeocCecdinic asimimeinecuLon >. ad )Olmine juhewseiss yi 
equations to the plant equations yields the augmented sys- 
tem (4.15) except that the last term has been eliminated 
and. A= A + BF. Rewriting equation (4.16) with the vector 
e(t) eliminated yields 

z= Aiz + Biu 


. Chae?) 
Be) 


ll 
os 
© 

lo 
uy 


where the meanings of aA end eye ore Clear iGo equa lO 
(4.15) and the definition for A above. 
The performance measure for this problem is identical 


to the performance measure (4.18) 


68 








tn 
aL 
Bon) a | [z'Q 2 + u'Ruldt (4.18) 


minere D578, 5 ands ih aie Fae defined in section B. 

The solution to the optimal control problem defined by 
dynamic system (4.62) and the performance measure (4.18) is 
well known. It can be obtained in a straightforward manner 
Hetlowing the derivation of section B;: The result is stated 
mere . 


ine sop bimalneconvrol tor Ciao cons trained so veme loc mae 


u*(t) = -R (t)BI(t)K(t)2(t) (4.63) 


where K(t) is the symmetric positive definite solution to 


mae Riccati matrix equation 


aoa 
= -A'K - KA + KB R BIK - 


le ~~) eel 


ix 
1g) 
oN 

+ 

GA 
tee 
Nee I 


Biemiecrix K{t) is an n(r+ijx(rtl)n square matrix. If K(t) 
is partitioned into (r+l) matrices each of dimension 
n(r+1)Xn, then K,,i = 1,...,(r+1), is the 4th n(r+1)Xn 
column partition. Using this notation 


ee 


u®¥ = -R B!' [K,x + 52a Keay s;]. (4.65) 


ie stiould be noted that F = ae K, and consequently the 

Meerax A in (4.64) is a funetion of elements oie 
Equation (4.65) is identical to the feedback term of 

e@uation (4.53), the optimal controller for the problem of 


Seetion B&B. The elimination of the open-loop term is an im- 


Pervane simplifications this controller can be implemenved 
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more easily. The blockKM@iarram Gleaerure 6) With bnew o pen 
loop eliminated, shows the structure such a controller could 
take. 

Kalman [3] has Shownethacsih the pari (hee Ba) ceneeloes 
is completely Controllabtes 1h Dy) — On (4 samc 
m)>8,,Q,, and R are constant matrices, then K(t)*K (a con= 
stant matrix) as t pre. Clearly if these conditions are met 
the Cassidy and Lee result can be extended to include the 
infinite-time constant feedback controller. This is an 
mporvant engineering result Since the matrices F and aye 
j=l,...,r, in equation (4.59) are constant matrices, con- 
sequently their implementation would be very simple. 

Under the conditions above, K = 0 and equation (4.64) 


becomes 


Q = - AIK - KA, + KBR 'BIK - Q,. (4.66) 


ae 


DE THE KAHNE CONTROL STRATEGY 

In his paper “Low Sensitivity Design of Optimal Linear 
Control Systems" [19], Kahne has proposed a design technique 
for the linear regulator problem that is similar to that of 
the previous section. As a further simplification however, 
imme treats the problem son whiten the dts¢raburaon maura x, 
Bi(t), is not a function of the parameters, q. Additionally 
Kahne neglects the term su/3a, entirely. He evaluates all 


Paegial derivataves at) q=q the nominal parameter values. 


or 


With these assumptions, the system and sensitivity constraints 


are defined by 








x(t) = A(t,q)x(t) + B(t)u(t) (4.67) 


rs 
om 
ct 
So 
ed 
ll 


£ 


and 


S,(t) = 3A,(t,q)x(t) + A(t,q)s,(t) (4.68) 


s, (to) = 0 


The sensitivity equation (4.68) is obtained by taking 
the partial derivative of (4.67) with respect to d,s under 
the assumptions stated above. Kahne's development con- 
sraered only a scalar parameter qi. He hinted tnat exten- 
sion to multiparameters is only a notational problem. The 
Baim rO re parameyvers 15 andicateq here. 

The vector s.(t) iswaefined by Gquation (3.03). sthne 


mee rix ~gA.(T.,a 


A, ( ,4) is defined by 


dA, (t,q) = 9A(t,q)/eq.. (4.69) 


MmemvectOrs, X(t) and u(t), and the matrices A(t,q) and 
ier are the same as those previously defined for (4.8). 


The augmented system is defined as 


x A 0 . 0 x B 
$1 aA, A . 0 S 0 
= e ° e e a ° u (AOD) 
; 3A 0 ak S 0 
=r —7 = =r = 
x(to) c 
S1(t ) O 
s_(to) bed 


co 








which can be wWricteen Wore Secolpacu saa. 


IN ¢ 


= AyzZ + By 


Is 


ae) 


Zi (eign) eZine 


IN 


Kahne defines the problem for low sensitivity design 
as follows: 
ied the admissible u*(t) that minimizes 

tp (4.18) 
Ie 22° (0. )D Zit.) + % [z'(t)Q, (t)2(t) + ul(t)R(t)u(t) Jat 
a 

subject to the constraints of (4.71), where D,3Q,> ange herciee 
moeaetined in section B. 

aie optimization problem has the same form as that of 


eeculon A. Again the solution is well known. 


wn SH & woe bY 4 


ine optimal controiler is 
u¥(t) = -R7'(t)B!(t)K(t)2(t) (4.72) 
Wewe K{t) is the symmetric positive definite solution to 


ie Riccati matrix differential equation 


(4.73) 
+. K(t)B (t)R B'(t)K(t)-Q (t) 


KG Ce) ca aaa Ge) 


kegs 


: p? = Dy 


PenVioOwiiiwone emlavimexeml > percat1on Gor form bik of 


equation (4.72) indicates that 


ee 








= ime 1 eich eel 
S2fe a to3 i eta 
Bt (t)K(t) = {Brgrar...0'] 
eel eel 
a ' ' t 
{ 2 ie ei Re Ket} : (tie) 


Wedel aia Cle oe elds (the torn sot) suicmc ommiom 


law 


ie 


io -1,, 
6 ae eee ee ii? 


Neue swnbavein thes Lormulavion tie @mavrix 2] an cquavaen 


al 
nis) is not a function of K(t). 
As in the Cassidy and Lee formulation, if the condi- 


— wt eA 


tions mentioned at the end of section A are met, then as 

b pres K(t)*K (a constant matrix). Then again K = 0, and 
equation (4.73) reduced to [(r+1)n]? nonlinear algebraic 
e@uabions. However, because K is symmetric only 

[(rt+1)n + 1] [(rti)n]/2 of the equations need to be soieea. 


iaewsobreuecuure Ob the Lowesensitiviuy control system 


mesulting from Kahne's’ approach is illustrated in Figure /. 


(3 








i 


R “B'K 


Bereure 7. 


-R 1B'k 


[> 


Block Diagram of Kahne'ts Low Seed Cian y 
Linear Regulator. 
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V. APPLICATIONS OR Soe) ose eae rea ee ONG) Eye nome 

FLEXIBLE SATURN BOOSTER PROBLEM 
A. THe PROBLEM 

In order to investigate some of the proposed low- 
sensitivity design strategies, a realistic problem was 
studied. The problem was to find a feedback control sys- 
tem for a large flexible booster and to apply several 
techniques in desensitizing its performance to parameter 
Werlations. The equations of motion and control theory 
aeeli1cable to the stability and response analysis for a 
large flexible launch vehicle were presented in detail by 
Garner [35] and modelled by Rillings (Saturn V-Apollo con- 
Memratbion) [36]. The dynamics of the Saturn V-Apollo 
faunehn vehicle was formulated and several constant—gain 
mocaback controllers were obtained and evaluated. 

It is well known that a long slender rod, unconstrained 
at its ends, when excited by a radial force pulse will vi- 
brate in bending modes and at frequencies determined by its 
meerctural ehnaracveris tics, = I iemeavuri V-Apolio Comite — 
tion of a launch vehicle can be characterized as a long 
slender rod having a length to diameter ratio of about 10:1. 
ie tiexible character of this booster system must be taken 
ime account when designing the control system. 

The large size of the Saturn V=Apollo configuration, 
shown in Figure 8, makes determination of the parameters 
describing its bending modes and frequencies extremely dif- 


ficult. The parameters are generally determined by dynamic 


2 








testing, and the resulting inaccuracies must be considered. 
Therefore, the control system must not be sensitive to these 
uncertain parameters. 

The problem is to design a constant-gain feedback con- 
troller that gives adequate control when the uncertain pa- 


rameters differ from the nominal values by as much as 20%. 


| 
LA —— gimballed engines 


(meters) 


Figure 8. Vehicle Configuration. 


Assuming exact knowledge of all of the states, a con- 
meet Lhnav consists of gimballing the engines producing eae 
merust for the booster, and two frames of reierence, 
Rillings [36] developed the following linear differential 


equations that describe the motion of the vehicle 
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F R'l Nt 1, 
= - aaa Base i E O ( Sea) 


ae Nt. y R! 

a= - (EP- Zorg - [e+ a - (Rls (5.2) 
- ; R'Y (XQ) 

eS een 1 aia B Conus) 
es Ot Cx) (5.4) 
b= ot ¥M(x Ln (5.5) 


where the variables are defined in Table l. The state vari- 


ables are defined as follows 


ay a 

X2 ee 

woe = 0, (SeG7 
Ky Nn 

X5§ n 


EVES UDS btu eS) meiG Cs ts Ivo ( Sellmeaiac so) 


the following state equations are obtained. 


bo = bn t EX'(xg) — ¥'CK,) IN 
| (5.7) 
a: N'1. 
o- arate ae a-¥'(x,,)w*n-2zwX'(x)n 
R'l R'Y(x.) 
ewe ' 6 
- | oO) ae | (5.8) 


ee eD Sw eee . T-D _¥ 
: mv “) °g i °r x : “) te (xq) mv ) 











= exes ae B (5229) 
n=n (5.10) 
a. : R'Y(xXg) 
Tl G0 ae 8 Ce aL) 


Making the notation compatible with that of chapter 


i¥, the control angle is defined by 


u = 8 (552) 


Wate Wig@ere eres jolehosniicigience ie) Vislalels| wlale Sayer ale Me avert 
ally very sensitive are w and Y"(x). In the following 
development only the single parameter, w, will be considered 
meeorder to limit the size of the problem. 

By cel iningeyie "cocci fietents Ol the matvix Ay and sie 


matrix B as 





Cc 
_ ' = i = 
ay Y (x5) ay Mi (x,,) 2. : 
io) N'o. v 
= =o =o ee 
oui ao a5 mv V “6 mv V 
1 1 
ae = : “cB sll ote b. = ae 
“1 I 23 2 mv 3 m 
eemeactions (5.7) —- (5.11) can be written in state variable 
form as | 
x = Ax + bu (sre) 
(cae 
a 0 10 0 | ay-a, x4 7 
Xy ne CO i a 0 
E 








TABLE I 


Nomenclature 


pitch angle 

angle of attack 
bending mode deflection 
thrust 

drag 

mass 


moment of inertia about C.G. (center of 
Sravivy 


distance from gimbal to Crea. 


distance imeom C1G.» towc.r. "\ cenver ol 
pressure 


vehicle velocity 

thrust oft gimballed engine 

normal aerodynamic force coefficient 
deflection mode shape at the gimbal 
bending mode damping 

bending mode frequency 


displacement at the pitch angle gyro due 
to the bending mode 


angular rave at the pitch angle rate gyro 
due to the bending mode 


pitch angle gyro output 
paren angle Rabe ye o OUL mY 


gimball engine angular deflection 
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Ee OPTIMAL SOLUTION 

All of the parameters 2 9) ane b vary consider ane, 
during the launeh phase as functions of time. However aaa 
order to simplify the example a frozen-time-point model of 
the vehicle was used. The control system for the time- 
invariant system should be designed for the most critical 
time of the launch phase. For this problem the time t = 80 
seconds was chosen. At this time the vehicle is subjected 
to extreme aerodynamic forces and wind disturbances. Zero 


problem time in subsequent solutions corresponds to flight 


time, t = 80 seconds. At t = 80 seconds the coefficients 
a, have the numerical values [36]: 
a. = 1.5xX10 °° a eae a = 22 -0210n- 
al 2 3 
: =? a = 7 =a) 
a) = 2.00X10 as = 1.37X10 ag = 4.07X10 
z al Z =D _ 2 
Pa or ax 10 Dawe oes hen en cee Oe 
items Matrix of equation (5.13) becomes foes 
0 ie 0 ( 8.0x107> 
0 0 2.03x1074 ~=—- -3.13x1072 = -9.. 36x107" 
7 =) aD mali = 
A=<-1. 37X10 Hie =a) eal) PO lou a ean ak 
0 0 0 0 it 
1 =a 
0 0 0 a eae Feely ae 
where ais Seedopemy sy iblaye b vector becomes 
0 
6.15X107~ 
b = 25. slibal (5.16) 
0 
2.55X10°° 
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The pair [A,;b] above are completely controliable; 
therefore, the optimal control 


we(t) = - Sb 'Kx(t) ‘Cai 


OT 


HG reece Ge) Goes) 


that minimizes the performance measure 


J = .f [x'Qx + pu?]dt (5.19) 
0 


has a constant gain vector f'. 
The optimal control for this system was obtained by 


mmperraving the Riccati equation 


"1 


= -A'K - KA + KB = BIK - Q (5.20) 


IA 


meowwards in Cime until a steady state solution was ob— 
tained using a 4th _order Runge-Kutta! integration scheme. 
pememoush K is a 5X5 matrix, only 15 equations were soived 


aque to symmetry. The constant-gain vector is given by 


pe ce. Gone) 


rr 
I 
I 
Dl 


The matrix Q and weighting factor used in the optimal 


solution were 


.75 0 0 0 
Orr Owe 0 0 

Q = 0 Seow 60 (Se22) 
0 0 0 0 
0 0 0 0 


1 
SUorOuUuULNO wn Oem ilins Computer Nacilaty. 
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and 


Dis =A CD eee 
The optimal control with w = wg was found to be 
(Sel 
i (2 3 Cm OO -.0229 -.0153}. 


Me optimal Crajecvorics , swith 0) = Wo 5 LOr sono. 

X3, and x, versus time are shown in Figure 9. These curves 
were obtained using an initial condition pitch angle rate 

of 5°/sec. to simulate a severe wind gust. The pitch angle, 
mares seem FCO damp out quite rapidly, however there is con- 
siderable oscillation at the natural bending mode frequency. 
The bending mode deflection, xX4, measured at the gimbal 
meer on, is large but damps out quite rapidly. The angie 

of attack stays small and returns close to zero in about 
three seconds. The angle of attack then remains at a small 
acceptable negative value for quite a long time. 

In order to observe the effects of parameter varia- 
forms On the system, the normalized trajectory error was 
defined as follows. Let Xx. be the trajectory determined 
Meme, the perturbed parameter, w, and let Xeg be the tra- 
meoeuvory determined using the nominal parameter, wo, then 


Pmeenormalized error, e.> ies defined by 


hae aoe 
a, se (5.25) 


al = Wa 
Pemielerniinime sensitivity in this way, there is no ques— 
mare about Sensitivity model approximations, or concern 


about excluded terms. 
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a 


Xy Pitch angle rate (deg/sec) 


© 


r\ 
Tes 
i” os Pitch angle (deg) 
0 f \ f 
setae ae ee ey 
a 





2 
~ X —Hngle of@=attack (der) 
/ N 
re eee ee a Rn SO... e : 
0 Sia ee t 
(sec) 
2 
V\, x, - Bending mode deflection (m) 
Lae wae 


PACU Ge ONO pv inidam COlwibo i We = ou) | see 
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EBEeror bra jeeuortes: | Of Di vtCheamcihe. C1» and bending 
mode sdet lectaonea, Ey along with the control, Us are ssneuwn 
in Figure 10. These curves were ener avedas Dyes tiie ec eanasiee 
tial condition of 5°/sec. for pitch rate. The perturbed 
parameter was w = 0.8 Wo: The pitch angle error trajectory 
C4 > is oscillatory at the frequency, wy it reachesta weak 
walue of about 1.2 and decays slowly to about 0.4 after 6 
Peconds. The bending mode dei lecvion error trajectory; Ey > 
was observed to have about the same general characteristics. 
Mme control history had a large initial value of about 10° 
which decayed rapidly to a small value. The coupling of 
the bending mode frequency onto the control was small but 
meticable. 

Aine ce soOrmals Zed Crieors res Ui omic ree cal tah te arenes 
analyze Beer bam They indicated that if parameter 
Variations were increased, that the error would be in- 
creased also, but this was already known from (5.25). 

In order to establish a measure for the sensitivity 
of a system which provided a meaningful basis for compari- 


Bem, the following integral squared errors were defined, 


i 
J =f Regal (53200) 


Ix 


J -f Ss Sait a2) 


1m 


and 


Al -f eu-dt . Cae 2g) 





-~ Normalized pitch error (sec) 


ms Nes ee 
Ge —¢ Cant 





a ~ Normalized bending mode deflection 
(m- hai ok, 


rs A 
0 —{-—\-- a ae wet an 


(sec) £ 


aaa 
a 
a 


10 


u - Gimbal angle (deg) | 








tt 
< 


PercuTe alo wep ota meow re I Aw=w. 0.8 wi; Y 
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The vector, s, in (5.27) was the same as that defined by 
equation (3.83). For the optimal controller, and nominal 


plant, wich Cp = 20 seconds, the values were 


J_ = 41.0 

=e 

Js = 1,550 
and 

I = .0393. 


In order to obtain more information about the sensi- 
tivity of the system to variations in w, the response of 
the optimal system was obtained for w = 0. dw. The re- 
sulting trajectories for x1, X2, X3, and X, versus time 


meee svown in Figure ll. Additionally, Jee Jos and Jy 


i 


ho. = 20 


fereewcomouteod for this case. The result with te 
, ii 


seconds was 


clon! 
a 

J_ = 146.4 
2 

J, = 0.0392. 


The system was excessively sensitive to a 20% variation in 
w. Additionally, the maximum bending mode deflection of 
eaeout ¢c.0 meters was excessive. 

iin Order wom Cues aie sensitivity several proposed 
wechnigques were utilized. The results are reported in the 


following sections. 
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x, - Pitch angle (deg) 


1 





ee Et 


Xo Pitch angle rate (deg/sec) 


x. - Angle of attack (deg) 





5 
DS aaa es ee 
I es (sec) 
e 
\ 
Ts Bending mode deflection (m) 
Or art 
i (sec) 





Prive ll. Optima yaGont row su = 0.6 15 ee ee 
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C., KAHNE'S METHOD 
By augmenting the system equation (5.13) with the sen- 


Sov ie eCla wien) 


See a) Ge Co) se) (5.29) 
mre waugmenvea sysvem 
z(t) = A,(w)z(t) + b u(t) (5.30) 
was obtained. The matrix 0A, = dA/dw, was defined by 
OO” 0 0 0 
Oe O20 —2a5W — 2.58) 
a = Onno me Omeno 0 (5.31) 
O° “Os SOO 0 


Mere the matrix A was defined by (5.14). The vector oP 


was defined by 


bio 


b, = 4--- (5.32) 


$O 


The matrix A, of equation (5.30) was defined by the parti- 


Cioned matrix 


aia eer ek (ese) 


The numerical values for A and b were defined by (5.15) and 
(5.16). The numerical values for the matrix dA, were the 


following 


88 








0 0 0 0 0 


Or ACEO ce alone eee cme 

ah, = <0 0 O 0 0 (Saale 
0 0 0 0 0 
Ge 0 recline ono conan ome 


The pair Ee b,] were not completely controllable for 
mas Case. Under these circumstances, the problem could nese 
be cast as an infinite-interval process, hence there was no 
guarantee that a solution with constant-gain feedback existed. 
Following a suggestion by Kirk [2], the problem was cast as 
a finite time problem of long duration. The problem was de- 
feed to find p(t) = f'(t)z{t) such that the performance 
measure 


Up 


eee Date) | [x'Qx + s'Ws + pu*]dt (5.35) 


0 
was minimized. The final time Up was chosen to be 200 sec- 
onds and the value of the weighting matrix was ve = 02 


IMecaweteitangs Matrix @ and isicalar 6 were derined voy 
oe22) and (5.23) respectively. The matrix W was defined 


by 


(5536) 


= 

I 
Oo. Or. jon eowe 
OS Gene 
OTe eco 2 
Sono nore 


al; 


The Riccati equations were integrated backwards in time 


and a nearly steady state solution was reached. Since Ue = 
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200 seconds was much longer than the interval of interest. 


the time-varying gains were approximated by 


Ft 
I 
| 
Dlh 


biK(0) . (5.37) 


It should be noted that obtaining the above solution re- 
gmared the solution of 55 nonlinear eatferential eauations. 
where the advantage of the symmetry of K(t) was used. 

The numerical values thus obtained for the feedback 


gains were 


Meath 2502158 1.06 —.207 s- 20526 
(5.38) 
0 0 0 -.494 -.0636}. 


Wie ora lectorLres [Or pit Ccheene he. Xy> Piven anelesrare. 


xX angle of attack, x., and bending mode deflection, Xp» 


2? 3 
O 


eon i) = Wo» 


MoRAcure Ne Snel Ose mila ons vince 
were present in Figure 9 are gone. The peak value of pitch 
angle has increased to about 3°. The over-shoot of angle of 
attack is also increased. The maximum bending mode deflec- 
Mmmom however has been reduced to about half of the value 
Obtained with the optimal controller, and the oscillations 
at the bending mode frequency have almost been eliminated. 


Figure 13 shows the sensitivity functions, = 9X5/ 00; 


zal 
a = 9X ),/ 90 ance vnemeCOont Omnis WO icy janis) Oty = © These 


sensitivity terms were reduced considerably compared to the 
Seeimal solution with no sensitivity considerations included. 


ine values For Jy Jos and ve with Up = 20 sec. and 


a= 0) Wie ie 
O 


ZO 
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Figure 12. Kahne Control: W=W 
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DLeUCe Ws eleMirestCOniro lb: ee"a = OG) 2 Y =o 


o2 








ZS 

J = oe 
and 

a = 20596. 


Figure 14 shows the trajectories with the parameter, 
W = 0.8. The trajectories x, and X changed less than 
10% from nominal at their maximum value, however, oy ae 
creases by almost 65%. This was a greater percentage change 
than the approximately 45% change that occurred with the 
same parameter variation for the optimal system. However, 
in this case even with a parameter change of 20%, the maxi- 
mum bending mode deflection was about 1.2 meters which is 


considerably less than the 2 meters for the optimal case. 


The values of Jy. Jo» and Joes with Up = 20 sec. and 


= 0.5u. were 


J = 3,82 
a = .538 
and 
Jo =e 2 O50 
u 59 
Figure 15 shows the sensitivity functions, = ac 9X, /3W ; 


Sy = 9X) /9W, and the control history, uw, for w = 0.8u. 

The system with Kanes controller was considerably 
less sensitive than the optimal system. In order to improve 
the sensitivity a trade-off between the variations of Xs Xo» 
ewicex = and CNG Varilapi ons. ol Xp and xX 


3 2 


trajectories occurred. There was large variation in the control 


and the sensitivity 
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Figure 15. Kahne Control: w = 0.6w 3 Y= yY 
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magnitudes. Kahne's controiler also resulted in a con- 
siderabie change in the oscillation itrequency and magnitude 


of the bending mode deflection which was a desired result. 


Be CASS SOG Iba Ss Wis Ole, 
In this case the system equation (5.13) was augmented 


Tee the Sensitivity equation 


S,(t) = 0Ar(wm)x(t) + A(w)si(t) + 9Bi(w)u(t) (a88) 
See enue 


The augmented system equation was 
ACD) IN (i ee) aB Teer Je (5.40) 


The matrix A,(w) was defined by the partitioned matrix 
i 


: , | 
hoe ne 2 5 ae (5.41) 
A, 


1c 


[>> 


mmere A and 39A,were defined by (5.14) and (5.31), respec- 


merely. in this case the vector b was not a function of 
Demenererore ob, = 0 and 
2 
bas og CS a2) 
0 


ime matrix A from equation (4.61) was A =A + bf'. &x- 
Peessing A in terms of elements of K instead of 1, A = 
pe 1/7? bb'K,4 which is the applicable expression obtained 


from (4.65). The nXn matrix K,. was defined by the parti- 


ee 
proned matrix 
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K = ee (5.13) 


IVES ING Telecel ay AAT eleaie cies JA, > and. BD were “de eiaedasion 
(ls). (5.16). and (5.24) ) respectively. Thesnumerscal 
Poomes for A remain to be determined. 

The problem was to find the u* = f'zg that minimized the 
performance measure (5.35) with weighting matrices Q and W 
and the weighting scalar o defined by (5.22), (5.36), and 
eee 3) - 


The modified 2nX2n matrix Riccati equation 


a Tatas ST igs eae aan 
a ! _ 1 r 
- ea ane” Ie ee ieee 
i \ (5.44) 
A io Q: 0 
>. eee + Kbbtk- ¢..3..7. 
= 1 t 
aA, : A-BD'K, | 02 
K(te) = 0 


was integrated backward in time until a steady-state solu- 
iron was obtained. 


Were 


Dj 
= 
ms 


Pie iuUNeImical Valviesmoo La inicGesl cone, == 


flake Sheen Se de Cs mere oe 2 
(Suclby 
123 oeeene Oe = ae Oooo) 


nN 


in this case with the numerical values of A devermined, 
tine pair [A, b] were completely controllable, therefore the 
conditions for the infinite-interval regulator problem to 


have a steady state solution were satisfied. 
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Figures 16 and 17 show the Cassidy and Lee control sys- 
tem trajectories X45 X5 > aoe Xyp> Sy> S 5» S jp and uw versus 
Gime Lor = Wo Comparing them to. Figures le and a 
(Kahne control system) showed small differences. Figures 
18 and 19 for the Cassidy and Lee control system, with 
W = 0.8w.; when compared with Figures 14 and 15, the com- 
parable trajectories for the Kahne control system, also 
Smewed Small ditferences. One concludes that the two 
methods were approximately equivalent in sensitivity reduc-— 
mem and control. Comparing Jy. Ls and an between the two 
systems indicated that the Caen Lee controller led 


to a less sensitive system but at a greater cost in J, 


The values I Js» and ae with Up = 20 sec. and w =W 


were 
Jy = BE eeo 
Js = 2909 
and 
ee = seer alae 
, 9 
for i) = 0. Bu, the values were 
Jy ee te i 
J. SIS 
and 
J = 0488. 
u 


Of “course, alblwotithe results voprained above were. d= 
rectly related to the weighting matrices Q@ and W used in the 
problem solutions. Both of these matrices were obtained by 


trial-~and--error techniques. 
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The weighting matrix, Q, was obtained by guessing a 
suitable form, solving thewRiccawmm= equation, and .Obt ai man 
ene resulting system trajectovmics se ihe valves in oewere 
perturbed until a system that was sensitive to variations 
in w was obtained. In addition to the sensitivity re- 
quirement, the maximum control magnitude was to be less 
than 10° and pitch angle, angle of attack and the maximum 
magnitude of bending mode deflection were to be small. 
i@ese criteria were partially achieved. 

ine Weighting Matrix, Wj 7Wwas selected "rem conser demas 
mons Of control, trajectory and sensitivity dispersions as 
indicated by the integral measures ee Jy and ii A para- 


meter, A, was defined such that 
= 0 
W =) (5.46) 


The Kahne solution was obtained for various values of A. 

The values of ate Jy. roel! ie were obtained, Per eae system 
determined by the vanes ie pyeinvesraving (5.20), eConeie 
and (5.28) with w = W and t, = 20 sec. The integrations 


were repeated for w = 0.dw.. Two additional integral mea- 


sures J and J were defined by 


QX Ws 
Jax f x'Qxdt (5.47) 


OS 








and c 


fe 
Furs -f s'Wsdat.. C5. 4a) 
6 
The values of these integrals for w = WA and w = 0.8. 
with Up = -0 Seconds Were Cerermnined hab Homiee Cone cmnis 


the values of Jy: Jax? Te Jus? and Jy determined for the 
Kahne control system with w = ae Values were determined 
corresponding to a range of values for AX from A = 0 (the 

optimal control) to A = 1. The Cassidy and Lee solution 

for A=.01 is also included. Table III contains the same 
information for w = 0.d8u.. 

From the data in Tables LI and III the trade-off 
curves of Figures 20 - 23 were obtained. Figure 20 shows 
the Pe se eodion of Jy versus the dispersion of Je as 
fesult 1s contrary aS that obtained by Cassidy ar Lee as 
shown in Figure 10 of [22]. The results indicated by Fig- 
ure 20 were as expected for this problem, however, since 
f@esweiehting matrix Q used in the performance measure in= 


dicated a.lack of concern about states Xy ands x It was 


5 
Beeepected that they would contribute heavily to Jy as they 
gag for the optimal case. The weighting naa iede W on the 
other hand was such that emphasis was placed on states xy 
and oe | 

Figures 21 and 22 indicate the cost in terms of control 
required to obtain a measured value of state and sensitivity 
trajectory dispersion respectively. Figure 23 indicates the 


optimal cost J* = Te as a function of sensitivity tra- 


ac an 


feerory dispersion. 
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TABLE II 
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C4 
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|< 
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0” W1.0 3.4x107> 
107° Ana 3.4x107> 
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iia toe 4 .1X107> 
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aon 2.6 8.1x107> 
10 1,5 7X10 ° 
ie” Foon earl 
CAL | - 3.8 5.4x107> 


De a ree a 


meoovimal Solution 
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DS 
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Ln 
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mie 
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Bee ee ees 
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116X107" 
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aloe 


a hee ok) 
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_2 
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5X10 
6.3x107° 
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Oo. 
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WwW = 0. Sw. 


eT 


3 
= 
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66.0 3.9X10 3 
me |) 3355 ae 
item | 19.7 4. 4X107? 
Meme! ates 5.4X107> 
10°? 6.7 7.7X107> 
lor 3.8 a) eae 
or el 3.4X107° 


Ia) 


146 
80 
30 


8.0x107° 


2.9X107" 


7.2X107" 


1.8x107> 
5.4x107> 
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ZO 


One 
0401 
0414 
0438 
nO o7 
.0596 
.0881 
eerie 
0491 


0392 


O40 

moet 2 
. 0436 
0484 
.0591 


Clee 








TABLE Ll convinueay 
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By studying the trade-offs indicated by Figures 21, 22, 


e 


mee 2s, a choice of A = 10 ~ or 10-2 becomes obvious. A 


value for 4 = 10°° was chosen. Figure 20 was checked with 
Mobs value and the choice was further confirmed. 

This was the method used for choosing the weighting 
Meaerix Ws a trial-and-error mevhod with added performance 
eureves tO aid in the design. 

The Kahne solution for A = .01 was chosen to be compared 
with the eeeeeay and Lee solution for the same value of i. 


ims was done and the results indicated previously further 


confirmed the choice of A. 


i, USE OF @ MATRIX FOR REDUCED SENSITIVITY 
Kalman [16] proved that the optimal feedback control 
law u* that minimizes the performance 


C 


e . 
J af [yx'Qx + y*Jdt (Bey 
0 


ead satisfies the constraints of a cenpletely eenvrollable 
iInear single-input planvy can be desensitized by the ap=- 
eeepriate choice of y. ~The assertion 4s that as y anerecase. 
the return difference increases and aero ty GO pari 
parameter decreases. The example of this chapter was solved 
mor y= 2.0 and for y = 1020. 
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The solutions were obtained in exactly the same way 
that the optimal Solution was 6b caine dee<Cep ry sudaver ae 
weighting matrix Q was multiplied by y. 


The gains obtained for y = 2.0 were 
| (5250) 
Blo 4 leer ee Ouray -.0346 -.0186}. 
Figure 24 shows the trajectories Ky> Xp X35 and xy 
versus time for w = Wo: The trajectories were almost 
mecmui1cal with those of Figure 9, the optimal case, y = i130; 
Che maximum value of xX) was larger, 1.55 compared to 1.4. 
The trajectories of Figure 24 were slightly more damped 
than those of Figure 9. 
Haare 25 Sshewio —urajeevorices x 


4 and xy versus 


Ree 3. 
time for w = 0.8w,. These trajectories were substantially 
the same as the comparable optimal trajectories of Figure 
ihe 

Mmicthougsh the maximum control amplitude increased by 
about 1.2°, there was not a significant improvement in the 


sensitivity of the system, as indicated by Figure 26. 


The gains for y = 10.0 were 


(So) 
f' = {3.97 3.74 2.69 -.0886 -.0303}. 

With a maximum control value of 19°, twice that for the 
optimal solution, a system with considerably more damping 
was obtained. However, the maximum bending mode deflection 
was also increased. The results are shown in Figures 27, 
28, and 29. As predicted by Kalman, the resulting system 
mas less Ssepemuameewith y= L020 than forgy = 2.0 (or 


vyo= 1.0 
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i. DISCUSSION OF RESULTS 

All of the methods used resulted in a system with re- 
duced sensitivity compared to the optimal solution. The 
Kahne and Cassidy and Lee solutions were obtained by con- 
siderably increasing the size of the problem (55 Riccati 
equations versus 15 for the optimal solution). The com- 
plexity of the problem increases enormously as additional 
parameters are considered. For example, if the parameters 
q= {w ranean a in the example had been used then 120 
Ricecati equations would have been integrated to obtain the 
eelutcion. Application of -these methods to a system in 
meubolae the product miG@erl)>iO0 results in almost prohibitive 
fomoucacional difficulties. Integepation of the 55 Rate@earts 
equations for the example with Up = J]00 sec. and using the 
largest possible time step that gave a stable solution, re- 


* time. This amount of com- 


quired 19 minutes of computer 
puter time is quite large when compared with the two minutes 
mmeurred Cor the solution of the optimal control. 

One of the advantages cited for using a technique that 
includes sensitivity in the performance measure is that it 
peer ides analytical control over the degree of insensitivivy 
obtained. Figure 20 and Figure 21 show that this is true; 
however, one must add that obtaining the weighting matrix 


Peenal proverdes suiser desiree OF sseteitiviuy weduamecd ora 


trial-and-error procedure. The data in Tables II and III 


2 
IBM - 360/67. 


HPLG 








were obtained by solving the Kahne problem seven times and 
the Cassidy and Lee problem and the optimal problem each 
once. This required over 160 minutes of computer time, a 
very great cost for most designs. The point is that these 
techniques were trial-and-error techniques as was finding 
the optimal solution, because no method of determining the 
weighting matrices Q and W was available. 

As stated earlier, there were two parameters to which 
the system was sensitive. The parameter q = w was chosen 
for the example because it did not appear inthe b matrix 
and therefore Kahne's technique was applicable. Desensi- 
tization of the system was achieved with respect to the 
parameter, w, but what of the parameter, an © See a There was 
nothing in the analysis technique that indicated how the "de- 
sensitized' system would respond to variations of a para- 
meter not explicitly included in tne performance measure. 
in fact it could very well happen that desensitizing with 
respect to one parameter might increase the sensitivity 
with respect to another. A designer having obtained a 
tentative solution to his control problem must check the 
sensitivity of the system to variations of the other plant 
parameters. In this example a check on sensitivity to 
cx.) only was made. 

The optimal control, the Kahne control, and the Cassidy 
and Lee control were each applied to the plant model with 
the parameters noe) = ery (increasing Bs) pro- 


duced the greatest sensitivity). The optimal system was 
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unstable in this Casecwasmr ie Cove yer) Corot. X49 Xo.» 


Xa and xy shown in Figure 30. The values of the integral 
measures for Y = leer, were 
J = 1794 
Js ae Oe) 
and 
J = .0429. 
u y 


The Kahne system response with Y = leery. was very 
nearly identical to the nominal system as shown in Fig- 
ure 31 and Figure 32. The values for the integral measures 


for Y = 1.27%, were 


Jy = 2.79 

Js =O es 
and 

ra = 0.0596. 


These values were very little different from those 
obtained for w = Oe and Y = YG Showa. 1n> table Ti. ein race 
the system was less sensitive to variations ie. Gbivawdeed. 
fee or Variations in w. 

The Cassidy and Lee system response with Y = l.eY. 
was also close to the nominal system as shown in Figure 33 
moa Figure 34. The variation was omly a Tittle larger than 


that noted for the Kahne controller. The values for the 


integral measures for Y = rae were 
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J. = 4.16 


= 
i =) Oa 
S 
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jee — 0 Or 
u 0.049 


it 15 interesting COmovre That eene soy svel Sensi hiv ine yay 
respect to w for Y = 1.2¥. was slightly less than for 


— 


the nominal case, J. = 0.28 compared to jeu Om2o Sen is 

was true for the feta COMO Lem wae nic aeons and Lee 
eontroller was less sensitive to variations in oo) 1; Aevemesiet 
feos) CO Variations 1. 

For this problem, the Kahne control system and the 
Cassidy and Lee control system provided very similar results 
in terms of sensitivity reduction as measured by the inte- 
gral measure J: The Kahne controiler provided this result 
with a less ee controller and with less computational 
@irticulty (A was not a function of elements of K for the 
Mmeame solution). 

Since the methods discussed were all essentially trial- 
and-error methods, perhaps more effort should have been put 
faeo Linding a weighting Matrix, Q, for the optimal case 
that gave results similar to those of Cassidy and Lee and 
Kahne. It is not at all clear how one obtains weighting 
matrices that provide Enema etecd result. For example, in 
the case of the problem presented in this chapter an at- 
tempt was made to solve the Riccati equation with Q = l. 


A solution could not be obtained because the integration 


wieckily Decane mMuntewrealiy unstable. 
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A second optimal solution with weighting matrix 


sD 
wOcl 0 


a= Bye. (Sage) 
00 

was obtained. The feedback gains were 

fF) = 125 2.98 Ie san26 =. 116 oes) 


This control law resulted in a system with greatly improved 
femorulVingy and performance, compared with the previouseop— 


timal solution, as indicated in Figures 35 - 38. 
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VI. CONCLUSIONS 


A. SUMMARY 

In this thesis several senstuvarny analysis andweesianm 
techniques as applied to optimal control systems have been 
evaluated. Of the methods of sensitivity analysis examined 
none provided a clear direction for extension to design 
techniques. 

ine baste wreesuits Olstalman  hericins™= ands Cruz. ame 
Kreindler, applicable to linear regulator systems, provided 
Smaeimportant bridge between optimal control theory in the 
time domain to classical control theory in the frequency 
domain. The direct relationship between stability and in- 
sensitivity demonstrated in the discussion of Kalman's work 
may contain a key to methods for applying some of the clas-— 
sical design techniques to the solution of desensitized 
mage CPoeuilavoOors.s LhiSswposscibiviGy awit) be Cdrseussed sma 
mgr next SECliON. 

A sensitivity analysis model for optimal feedback sys- 
tems was developed following well known methods. The re- 
sulting sensitivity equation was specialized to the linear 
regulator problem. The main disadvantage of this approach 
Pomclac ah tndependeitmadalyols doe required, for each (para- 
meter considered. The Perkins and Wilkie analysis method 
eliminates this disadvantage for completely controllable 
linear regulators by solving for ee eTree sensitivity to 
all parameters simultaneously. This is accomplished by 


transforming the state equations to the companion canonic 


a0 








form, in which all of the parameters of the original system 
combine to form the coefficients of the open-loop character- 
istic equation. 

Utilizing the sensitivity equation 


du 


oq. 





Soe OP eee (3.84) 
cal sate =i = 


eel 


an optimization problem with sensitivity constraints was 
formulated and solved for the linear case. The resulting 
control law, due to Higginbotham, proved to be very diffi- 
cult if not impossible to implement. Two simplified tech- 
niques, resulting from simplifying assumptions and neglected 
terms in the sensitivity equation, as proposed by Cassidy 
and Lee, and Kahne were introduced. These schemes required 
augmenting the nth_order system equation with r nth_order 
sensitivity equations, and including a quadratic sensitivity 
term in the performance measure. The increase in size and 
eemoucational ditficulty of the resulting optiamizavion prep— 
lem severely limits the utility of these techniques. 

In order to apply some of the techniques discussed, a 
5¢N_order linearized model of a flexible Saturn V-Apollo 
launch vehicle during booster powered flight was presented. 
An optimal (intentionally sensitive) solution to the re- 
sulting linear regulator problem was generated. The state 
equations were then augmented with the Kahne sensitivity 
equations and the resulting 10%h-order optimization problem 


was solved. The Cassidy and Lee solution was also obtained. 


le Sge 








Both of these methods yield control laws that provide con- 
Siderably reduced sensitivity compared to the optimal sys- 
eum. 

Kalman suggested that sensitivity could be decreased 
by solving the modified optimization problem obtained by 
multiplying the trajectory weighting matrix, Q, by a scalar 
y. Solutions to the resulting problem with y = 2 and 
y = 10 were obtained. The resulting systems were indeed 
iso sensitive than the opvamal with yy — 2) but at aueest 
of Consideraply more Controleeiiors:. 

The problem was also solved as an unconstrained optimal 
control problem with a different trajectory weighting ma- 
terx, O- The resulting system had Bee ee Characters case 
similar to those obtained by the Cassidy and Lee, and Kahn 
mevaods. 

With these results one is forced to ask "why bother with 
these extremely complex techniques, if the same result can 
be obtained by solving the much simpler unconstrained optimal 
eemterol problem"? The answer is not at all clear since both 
approaches are trial-and-error with respect to determining 
weighting matrices. It was clear, however, that a better 
unconstrained design oun Dewonvainea at "Scnsativaicy were 
Considered at each iterative step in the design process. 
Generating the data for the design curves of Figures 20-23, 
once the feedback gains were obtained, required much less 
Pompurational ellovreueumomrcolvimne une Ruceora ecqluaulon: 
Similar design aids could be generated and used in obtaining 


the "best" unconstrained optimal solution. 


a 








Be RECOMMENDATIONS 

A design technidgue for reduced sensitavity opramal 
controls which does not require augmenting the state equa- 
tions or adding a term to the performance measure would be 
a highly desirable result. An area for further work with 
this in mind was found in Kalman's result for the inverse 
problem [16]. 

The basis for the design algorithm to be outlined is 
contained in the following ideas: 

1) A completely controllable linear single-input sys- 
tem can be transiormed into the companion canonic form. 

2) The system characteristic equation is invariant 
Mmaer such a linear transformation. 

Oo Nestonme conuro!. “ae & for = ccm 
maple linear single-input system is an optimal control Lay 


mand only if 


| 1 - fte(s)bl? = [¥,(s)/¥(s)|2>1 (3.25) 


or 


Iv, (jw) [*- [w(jw) |*>0. cr) 


4) The polynomials vy, and " are the closed-loop and 
open-loop system characteristic polynomials. 

5) For a system in companion canonic form, if the 
open-loop characteristic polynomial is 


¥(s) = sg” 4 a + ... + Q] (6.2) 


then the closed loop characteristic polynomial can be written 


as 


i> 








¥ (8) = s+ (One ome Hae antes 1 Ol einen Yi) (Grey) 


i ae ee alc Ys are the elements of the feedback gain vector 


ie. = {y, VQ «sic es (6.4) 


6) The control law in the companion canoniec form is 
given by 
u = f'z (6.5) 


Mgaee 7 ls whe piiase—Vvar table (Ss taue svecror. Since 


2 eee, (6.6) 


because of the linear transformaticn to companion canonic 
form, the feedback gains in the original coordinate system 


eee) Civen by 


kt £'T (6.7) 


A design procedure that results from consideration of 
the listed ideas is the following: 
1) Transform the completely controllable constant 


Single-input system 
x = Ax + by (6.8) 


into the companion canonic form using the Leverrier-Faddeeva 
eeeeorithm (37). This algorithm elas the characteristic 
Belynomial, Y(s) and the linear transformation, 1. 
2pm Ob Gas aes cater mee com ten mecelen y, in Slobeywstore (ise 4h)) < 
3) Using a search routine, find a set of ee 1 eee 
what make (6.3) Huryrez see on caeenvalue stinging TroOubi ne saiicere 
scheme that reduces the real part of the largest eigenvalue 


would work well here. A design constraint on the location of 
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the largest eigenvalue can also be included here. The value 
of (a1 —- Yi) must be constrained to be greater than a, as 
View DiC wa. in. 

4) Having obtained a stable control law, f' = 


Tala Vio says Ynts test Condition Ooms ehellows. 


. 2 2 - 2 
a) |v, (jo) |? = ¥ (w?) 
ago Similarly 


ly(ju)]2 = w(w2). 


Therefore, condition (6.1) is reduced to 


W(w2) = Ylw2)> 0 (6.9) 


b) Since Y,.(w*) and with bearer nonnegative. morsel 


epeeona since in step 3 the constraint 
W, (0) > pd) Cceap 


was imposed by requiring the condition (a1 - yi) > a1, then 
memaition (6.9) holds forsall wif and only if the equation 
Y.(w*) - p(w?) = 0 (Gains) 
has no real roots. 
Ce ihe testmehenp is MtomiIndmume rOons Ob w( ode. 
mee rione are real, then (6.9) Hoo eiehs te Cady hrs ai opti- 
mee control law. if (6-11) has real roots, the process must 


meerepeaved uncmitoasscumoapie 1 waseiound. 


5) Having found f', obtain k' from 


eae (6.7) 


oD 








A variation to the procedure wuvenm Jdimits the mannii 
value of the return difference sites ebeatned by sedih ane 


COnGa t@mmncO.. oO) ssl chimipmeatn 
v,.(w?) - 02H (w2) > 0 (6.12) 


where 


p21 


such a procedure will ensure that the return difference is 
greater than op for all w. That is condition (3.25) be- 


comes 
[d= £°9(s)bl~ = (¥Cs)7¥(s)]* > p* (6.13) 


There is a connection between the magnitude of p and 
the system sensitivity but it is not clear at this point. 
The choice of p, therefore, remains a problem to be solved. 

This procedure, which could incorporate classical tech- 
niques for determining constraints for the eigenvalues of 
the closed-loop system, provides a simple bridge between 
Seurnal Control systems and classical control systems. If, 
for example, consideration is limited to a range of fre- 
quencies, w < w,, the control resulting would not be optimal 
Puc would satisfy the closed-loop requirements of a clas- 
Sical system. 

It is very likely that this technique can be extended 
to multiple-input completely controllable systems using the 
arguments of Wilkie and Perkins [15]. Since the systems 


are linear, it follows from Superposition that 
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a x* + x* 1 eal x 


where x7 1$ the response tovconccol Us ge ols 


Gon) 


The 


control laws for the decoupled single-input systems could 


be determined and recombined to form an optimal nxXm gain 


Matrix, FH. The nXm matrix f would have the torm 


Pe{k, Xo . a Kn 3 


(Oo) 


Cone) 


The f, of (6.16) are obtained using the above procedure. 


iS 
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